2020-02-12T13:59:54.623 INFO:root:teuthology version: 1.0.0-ee19bca 2020-02-12T13:59:54.623 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.RFasXN.tmp -- --verbose --lock --description fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_suites_pjd.yaml} --name pdonnell-2020-02-12_01:56:22-fs-wip-pdonnell-testing-20200211.222321-distro-basic-smithi --block --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2020-02-12_01:56:22-fs-wip-pdonnell-testing-20200211.222321-distro-basic-smithi/4755697 2020-02-12T13:59:54.666 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-02-12T13:59:54.729 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2020-02-12_01:56:22-fs-wip-pdonnell-testing-20200211.222321-distro-basic-smithi/4755697 branch: wip-pdonnell-testing-20200211.222321 description: fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_suites_pjd.yaml} email: pdonnell@redhat.com first_in_suite: false job_id: '4755697' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2020-02-12_01:56:22-fs-wip-pdonnell-testing-20200211.222321-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: centos os_version: '8.1' overrides: admin_socket: branch: wip-pdonnell-testing-20200211.222321 ceph: cephfs_ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 fuse default permissions: false fuse set user groups: true mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd_max_omap_entries_per_request: 10000 fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 7df2194963eaa185d198b9c90e899c7e7ae9eb30 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: 7df2194963eaa185d198b9c90e899c7e7ae9eb30 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20200211.222321 sha1: 7df2194963eaa185d198b9c90e899c7e7ae9eb30 owner: scheduled_pdonnell@teuthology priority: 75 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 sha1: 7df2194963eaa185d198b9c90e899c7e7ae9eb30 suite: fs suite_branch: wip-pdonnell-testing-20200211.222321 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200211.222321/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 7df2194963eaa185d198b9c90e899c7e7ae9eb30 tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - dump - indent rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - ceph: null - exec: client.0: - sudo ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - ceph-fuse: null - workunit: clients: all: - suites/pjd.sh timeout: 6h teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.11870 2020-02-12T13:59:54.729 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200211.222321/qa; will attempt to use it 2020-02-12T13:59:54.731 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200211.222321/qa/tasks 2020-02-12T13:59:54.731 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-02-12T13:59:54.732 INFO:teuthology.task.internal:Checking packages... 2020-02-12T13:59:54.747 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash '7df2194963eaa185d198b9c90e899c7e7ae9eb30' 2020-02-12T13:59:54.747 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-02-12T13:59:54.747 INFO:teuthology.packaging:ref: None 2020-02-12T13:59:54.747 INFO:teuthology.packaging:tag: None 2020-02-12T13:59:54.747 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20200211.222321 2020-02-12T13:59:54.747 INFO:teuthology.packaging:sha1: 7df2194963eaa185d198b9c90e899c7e7ae9eb30 2020-02-12T13:59:54.748 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20200211.222321 2020-02-12T13:59:54.917 INFO:teuthology.task.internal:Found packages for ceph version 15.1.0-567.g7df2194 2020-02-12T13:59:54.917 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-02-12T13:59:54.931 INFO:teuthology.task.internal:no buildpackages task found 2020-02-12T13:59:54.931 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-02-12T13:59:54.989 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-02-12T13:59:54.989 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-02-12T13:59:55.040 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_pdonnell@teuthology', 'description': '/home/teuthworker/archive/pdonnell-2020-02-12_01:56:22-fs-wip-pdonnell-testing-20200211.222321-distro-basic-smithi/4755697', 'machine_type': 'smithi'} 2020-02-12T13:59:55.060 DEBUG:teuthology.lock.ops:locked ubuntu@smithi072.front.sepia.ceph.com, ubuntu@smithi139.front.sepia.ceph.com 2020-02-12T13:59:55.122 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-02-12T13:59:55.315 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of centos 8.1 2020-02-12T13:59:55.318 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of centos 8.1 2020-02-12T13:59:55.609 INFO:teuthology.orchestra.console:Power off smithi139 2020-02-12T13:59:55.609 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-02-12T13:59:55.624 INFO:teuthology.orchestra.console:Power off smithi072 2020-02-12T13:59:55.624 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-02-12T13:59:55.631 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-12T13:59:55.643 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-12T13:59:55.750 INFO:teuthology.orchestra.console:Power off for smithi139 completed 2020-02-12T13:59:55.763 INFO:teuthology.orchestra.console:Power off for smithi072 completed 2020-02-12T13:59:55.852 INFO:teuthology.orchestra.console:Power on smithi139 2020-02-12T13:59:55.852 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-02-12T13:59:55.864 INFO:teuthology.orchestra.console:Power on smithi072 2020-02-12T13:59:55.864 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-02-12T13:59:55.872 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-12T13:59:55.883 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-12T13:59:59.895 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-12T13:59:59.905 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-12T14:00:00.105 INFO:teuthology.orchestra.console:Power on for smithi139 completed 2020-02-12T14:00:00.115 INFO:teuthology.orchestra.console:Power on for smithi072 completed 2020-02-12T14:00:00.207 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish 2020-02-12T14:00:00.216 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish 2020-02-12T14:02:46.189 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi139.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:02:55.259 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi139.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:03:01.268 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi072.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:03:04.313 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi139.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:03:10.327 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi072.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:03:13.367 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi139.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:03:19.384 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi072.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:03:22.423 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi139.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:03:28.439 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi072.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:03:31.479 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi139.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:03:37.499 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi072.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:03:40.539 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi139.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:03:46.554 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi072.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:03:55.611 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi072.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:04:04.667 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi072.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:04:12.489 INFO:teuthology.orchestra.run.smithi139:> hostname 2020-02-12T14:04:12.872 INFO:teuthology.orchestra.run.smithi139.stdout:smithi113 2020-02-12T14:04:12.873 INFO:teuthology.orchestra.run.smithi139:> grep smithi113 /etc/hosts 2020-02-12T14:04:12.889 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.113 smithi113.front.sepia.ceph.com smithi113 2020-02-12T14:04:12.890 INFO:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2020-02-12T14:04:13.020 INFO:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi113/smithi139/g' /etc/hosts 2020-02-12T14:04:13.048 INFO:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/172.21.15.113/172.21.15.139/g' /etc/hosts 2020-02-12T14:04:13.115 INFO:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi113/smithi139/g' /etc/hostname 2020-02-12T14:04:13.182 INFO:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2020-02-12T14:04:13.249 INFO:teuthology.provision.fog.smithi139:Deploy complete! 2020-02-12T14:04:13.251 DEBUG:teuthology.parallel:result is None 2020-02-12T14:05:10.716 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi072.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:05:11.036 INFO:teuthology.orchestra.run.smithi072:> hostname 2020-02-12T14:05:11.327 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072.front.sepia.ceph.com 2020-02-12T14:05:11.327 INFO:teuthology.orchestra.run.smithi072:> grep smithi072.front.sepia.ceph.com /etc/hosts 2020-02-12T14:05:11.341 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072.front.sepia.ceph.com smithi072 2020-02-12T14:05:11.342 INFO:teuthology.orchestra.run.smithi072:> sudo hostname smithi072 2020-02-12T14:05:11.471 INFO:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hosts 2020-02-12T14:05:11.499 INFO:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/172.21.15.72/172.21.15.72/g' /etc/hosts 2020-02-12T14:05:11.566 INFO:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hostname 2020-02-12T14:05:11.633 INFO:teuthology.orchestra.run.smithi072:> sudo hostname smithi072 2020-02-12T14:05:11.699 INFO:teuthology.provision.fog.smithi072:Deploy complete! 2020-02-12T14:05:11.701 DEBUG:teuthology.parallel:result is None 2020-02-12T14:05:11.826 INFO:teuthology.lock.ops:Checking smithi139.front.sepia.ceph.com 2020-02-12T14:05:11.826 INFO:teuthology.lock.ops:New key found. Updating... 2020-02-12T14:05:11.842 INFO:teuthology.lock.ops:Checking smithi072.front.sepia.ceph.com 2020-02-12T14:05:11.842 INFO:teuthology.lock.ops:New key found. Updating... 2020-02-12T14:05:11.859 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: set os type and version on server 2020-02-12T14:05:11.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T14:05:11.861 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi139.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:05:11.929 INFO:teuthology.orchestra.run.smithi139:> true 2020-02-12T14:05:12.096 INFO:teuthology.orchestra.run.smithi139:> uname -m 2020-02-12T14:05:12.149 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2020-02-12T14:05:12.150 INFO:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2020-02-12T14:05:12.202 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Linux" 2020-02-12T14:05:12.203 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8 (Core)" 2020-02-12T14:05:12.203 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2020-02-12T14:05:12.203 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2020-02-12T14:05:12.203 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8" 2020-02-12T14:05:12.203 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8" 2020-02-12T14:05:12.203 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-02-12T14:05:12.204 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2020-02-12T14:05:12.204 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-02-12T14:05:12.204 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.centos.org/" 2020-02-12T14:05:12.204 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-02-12T14:05:12.204 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:05:12.204 INFO:teuthology.orchestra.run.smithi139.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-02-12T14:05:12.204 INFO:teuthology.orchestra.run.smithi139.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-02-12T14:05:12.205 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-02-12T14:05:12.205 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-02-12T14:05:12.205 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:05:12.206 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2020-02-12T14:05:12.220 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: set os type and version on server 2020-02-12T14:05:12.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T14:05:12.221 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi072.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:05:12.287 INFO:teuthology.orchestra.run.smithi072:> true 2020-02-12T14:05:12.447 INFO:teuthology.orchestra.run.smithi072:> uname -m 2020-02-12T14:05:12.501 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2020-02-12T14:05:12.501 INFO:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2020-02-12T14:05:12.555 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Linux" 2020-02-12T14:05:12.555 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8 (Core)" 2020-02-12T14:05:12.555 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2020-02-12T14:05:12.555 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2020-02-12T14:05:12.556 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8" 2020-02-12T14:05:12.556 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2020-02-12T14:05:12.556 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-02-12T14:05:12.556 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2020-02-12T14:05:12.556 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-02-12T14:05:12.556 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.centos.org/" 2020-02-12T14:05:12.557 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-02-12T14:05:12.557 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:05:12.557 INFO:teuthology.orchestra.run.smithi072.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-02-12T14:05:12.557 INFO:teuthology.orchestra.run.smithi072.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-02-12T14:05:12.557 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-02-12T14:05:12.557 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-02-12T14:05:12.557 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:05:12.558 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2020-02-12T14:05:12.574 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-02-12T14:05:12.608 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi072.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnHMvD6RQ6Q8i47DmZmyGMSc70N3w8B9n1FuwiNM/AnD/whcV/HceCP0uR4TmpPLrmesyuk4OxyK4VHBJWWCBxc9+2KwAIJDU24Dw3Pu5CQEyFH8GDn62BWnCBIswY3XrlU7JAceZUCk+/B++dRDA0QdpJfRZ+TnvXf4yfxuc1qS1pe7wSNKwdehOxHVmzJmYVRzAnEMCm9ID4qb9PxAVYEuyPOFl55NpDmsqAqgx3+V6G4XEh2j5HbWxgpDq/3ALTrFx3zQSKykW87vOFMcQE1EhVq6UHYWtJtipOnlg/jtezqiyrC0iZ3XkLhoLC9C3lVOtDQi7Bs24t54uJ8oYFPygRw0KH8bDz9dlaBTSz7PpLJqv9pqkpciKH3Tn90peYhRJ8llr958V1MShYbRBmyO5+TNNcIr0M8Zu/42S8nMV+8HL4sJTYuOMvPP28QyPenadQIo+VaY4hwB72BovsYxr6rlBg6JR4ECUDhiVPB5S3RERIS2C3baT9paMPXIs= smithi139.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwiFjJCK9g9UbnDOuaOCMFVr9ptdtMvb4kdC/Co8sxcPmBixcOvVlVGRlqqD9T+J0a2AOq4A3IBemCOWqxZyw6XYP/Mt63asiUFZwfTcqVL033j5II8cmOdf1+QYLaBcOeLIfvr+nzDlczklXJ4rT1v7ZJRHJRfRP5m0gQxcyXwQvErxbN161tmmdK8xPb8AKw1x2PD2iiAVzUkv7RRAb4JQ+kxicWKnVoLVgNKKZNYe744lg9v4z+GjqRW22TtnKSj760WJ9Dtqlwvbm8v27KvZM+2B2b01GJeCTeWB96EKVBhDLNsL/mb1GCLHzCJ1bNwr16k/cJ2dYCGKIXSRhDa8jyC9i+9L3kgme/TJKMjq7m/SogLJCJFOpghZ9WZ8/odGksFwI9Ctu52Z3rpUWVvfiDMMssb9hD0oBqag33kAxrCgGMi8UkB9cFY5TE8OdI1J5WyMpEVmTuLmnIGmmzMRPj6zfaNgGaeaTak+BZN2mAWUZIF4ksxg42rhwWSe8= 2020-02-12T14:05:12.608 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-02-12T14:05:12.666 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-02-12T14:05:12.674 INFO:teuthology.task.internal:Saving configuration 2020-02-12T14:05:12.693 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-02-12T14:05:12.701 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-02-12T14:05:12.718 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-02-12 13:59:55.048467', u'locked_by': u'scheduled_pdonnell@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi139.front.sepia.ceph.com', u'os_version': u'8', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBELkkWOrSkhNJMiT5lWNAal4s/OVbiq+jb5TxZo3DhsVF+R/G6fjsZe8d6nRbY/09Zz0FcqBmM4rD26frtcfDqc=', u'description': u'/home/teuthworker/archive/pdonnell-2020-02-12_01:56:22-fs-wip-pdonnell-testing-20200211.222321-distro-basic-smithi/4755697'} 2020-02-12T14:05:12.734 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-02-12 13:59:55.048488', u'locked_by': u'scheduled_pdonnell@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi072.front.sepia.ceph.com', u'os_version': u'8', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIrTqWsIR4L2vEAM29zuNWjEzLnqKMUxOE6mtWJFI2mviq/eMnHslmnbpt53JTbC9RlIkQWWOOtQf2Iz3eASDNk=', u'description': u'/home/teuthworker/archive/pdonnell-2020-02-12_01:56:22-fs-wip-pdonnell-testing-20200211.222321-distro-basic-smithi/4755697'} 2020-02-12T14:05:12.734 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-02-12T14:05:12.743 INFO:teuthology.task.internal:roles: ubuntu@smithi139.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2020-02-12T14:05:12.743 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2020-02-12T14:05:12.743 INFO:teuthology.run_tasks:Running task console_log... 2020-02-12T14:05:12.807 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-02-12T14:05:12.808 INFO:teuthology.run_tasks:Running task internal.connect... 2020-02-12T14:05:12.816 INFO:teuthology.task.internal:Opening connections... 2020-02-12T14:05:12.816 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi072.front.sepia.ceph.com 2020-02-12T14:05:12.817 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi072.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:05:12.886 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi139.front.sepia.ceph.com 2020-02-12T14:05:12.887 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi139.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:05:12.957 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-02-12T14:05:12.965 INFO:teuthology.orchestra.run.smithi072:> uname -m 2020-02-12T14:05:13.004 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2020-02-12T14:05:13.004 INFO:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2020-02-12T14:05:13.058 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Linux" 2020-02-12T14:05:13.058 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8 (Core)" 2020-02-12T14:05:13.058 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2020-02-12T14:05:13.058 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2020-02-12T14:05:13.059 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8" 2020-02-12T14:05:13.059 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2020-02-12T14:05:13.059 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-02-12T14:05:13.059 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2020-02-12T14:05:13.059 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-02-12T14:05:13.059 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.centos.org/" 2020-02-12T14:05:13.059 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-02-12T14:05:13.060 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:05:13.060 INFO:teuthology.orchestra.run.smithi072.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-02-12T14:05:13.060 INFO:teuthology.orchestra.run.smithi072.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-02-12T14:05:13.060 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-02-12T14:05:13.060 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-02-12T14:05:13.060 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:05:13.061 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2020-02-12T14:05:13.077 INFO:teuthology.orchestra.run.smithi139:> uname -m 2020-02-12T14:05:13.091 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2020-02-12T14:05:13.092 INFO:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2020-02-12T14:05:13.145 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Linux" 2020-02-12T14:05:13.145 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8 (Core)" 2020-02-12T14:05:13.145 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2020-02-12T14:05:13.146 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2020-02-12T14:05:13.146 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8" 2020-02-12T14:05:13.146 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8" 2020-02-12T14:05:13.146 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-02-12T14:05:13.146 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2020-02-12T14:05:13.146 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-02-12T14:05:13.146 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.centos.org/" 2020-02-12T14:05:13.147 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-02-12T14:05:13.147 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:05:13.147 INFO:teuthology.orchestra.run.smithi139.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-02-12T14:05:13.147 INFO:teuthology.orchestra.run.smithi139.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-02-12T14:05:13.147 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-02-12T14:05:13.147 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-02-12T14:05:13.148 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:05:13.148 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2020-02-12T14:05:13.163 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-02-12T14:05:13.214 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-02-12T14:05:13.224 INFO:teuthology.task.internal:Checking for old test directory... 2020-02-12T14:05:13.225 INFO:teuthology.orchestra.run.smithi072:> test '!' -e /home/ubuntu/cephtest 2020-02-12T14:05:13.227 INFO:teuthology.orchestra.run.smithi139:> test '!' -e /home/ubuntu/cephtest 2020-02-12T14:05:13.240 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-02-12T14:05:13.250 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-02-12T14:05:13.251 INFO:teuthology.orchestra.run.smithi072:> test -z $(ls -A /var/lib/ceph) 2020-02-12T14:05:13.280 INFO:teuthology.orchestra.run.smithi139:> test -z $(ls -A /var/lib/ceph) 2020-02-12T14:05:13.299 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-02-12T14:05:13.345 INFO:teuthology.run_tasks:Running task kernel... 2020-02-12T14:05:13.362 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mds.a': {'sha1': 'distro', 'kdb': True}, 'mds.b': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}} 2020-02-12T14:05:13.362 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2020-02-12T14:05:13.363 INFO:teuthology.orchestra.run.smithi139:> uname -r 2020-02-12T14:05:13.376 INFO:teuthology.orchestra.run.smithi139.stdout:4.18.0-147.5.1.el8_1.x86_64 2020-02-12T14:05:13.376 INFO:teuthology.task.kernel:Running kernel on smithi139: 4.18.0-147.5.1.el8_1.x86_64 2020-02-12T14:05:13.376 INFO:teuthology.orchestra.run.smithi139:> sudo yum install -y kernel 2020-02-12T14:05:15.939 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 22:16:16 ago on Tue 11 Feb 2020 03:48:59 PM UTC. 2020-02-12T14:05:16.332 INFO:teuthology.orchestra.run.smithi139.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-02-12T14:05:16.332 INFO:teuthology.orchestra.run.smithi139.stdout:Package kernel-4.18.0-147.5.1.el8_1.x86_64 is already installed. 2020-02-12T14:05:16.494 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2020-02-12T14:05:16.495 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2020-02-12T14:05:16.495 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2020-02-12T14:05:16.651 INFO:teuthology.orchestra.run.smithi139:> echo no | sudo yum reinstall kernel || true 2020-02-12T14:05:17.035 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 22:16:18 ago on Tue 11 Feb 2020 03:48:59 PM UTC. 2020-02-12T14:05:17.397 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2020-02-12T14:05:17.397 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2020-02-12T14:05:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: Package Architecture Version Repository Size 2020-02-12T14:05:17.398 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2020-02-12T14:05:17.398 INFO:teuthology.orchestra.run.smithi139.stdout:Reinstalling: 2020-02-12T14:05:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 BaseOS 1.5 M 2020-02-12T14:05:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: kernel x86_64 4.18.0-147.el8 BaseOS 1.5 M 2020-02-12T14:05:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:05:17.399 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2020-02-12T14:05:17.399 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2020-02-12T14:05:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:05:17.400 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 3.1 M 2020-02-12T14:05:17.400 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 0 2020-02-12T14:05:17.400 INFO:teuthology.orchestra.run.smithi139.stderr:Operation aborted. 2020-02-12T14:05:17.506 INFO:teuthology.orchestra.run.smithi139.stdout:Is this ok [y/N]: 2020-02-12T14:05:17.506 INFO:teuthology.orchestra.run.smithi139:> sudo yum reinstall -y kernel || true 2020-02-12T14:05:17.887 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 22:16:18 ago on Tue 11 Feb 2020 03:48:59 PM UTC. 2020-02-12T14:05:18.233 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2020-02-12T14:05:18.234 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2020-02-12T14:05:18.234 INFO:teuthology.orchestra.run.smithi139.stdout: Package Architecture Version Repository Size 2020-02-12T14:05:18.234 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2020-02-12T14:05:18.235 INFO:teuthology.orchestra.run.smithi139.stdout:Reinstalling: 2020-02-12T14:05:18.235 INFO:teuthology.orchestra.run.smithi139.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 BaseOS 1.5 M 2020-02-12T14:05:18.235 INFO:teuthology.orchestra.run.smithi139.stdout: kernel x86_64 4.18.0-147.el8 BaseOS 1.5 M 2020-02-12T14:05:18.235 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:05:18.235 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2020-02-12T14:05:18.235 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2020-02-12T14:05:18.235 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:05:18.236 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 3.1 M 2020-02-12T14:05:18.236 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 0 2020-02-12T14:05:18.236 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2020-02-12T14:05:19.219 INFO:teuthology.orchestra.run.smithi139.stdout:(1/2): kernel-4.18.0-147.5.1.el8_1.x86_64.rpm 1.8 MB/s | 1.5 MB 00:00 2020-02-12T14:05:20.207 INFO:teuthology.orchestra.run.smithi139.stdout:(2/2): kernel-4.18.0-147.el8.x86_64.rpm 849 kB/s | 1.5 MB 00:01 2020-02-12T14:05:20.208 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2020-02-12T14:05:20.208 INFO:teuthology.orchestra.run.smithi139.stdout:Total 1.5 MB/s | 3.1 MB 00:01 2020-02-12T14:05:20.231 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2020-02-12T14:05:20.408 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2020-02-12T14:05:20.408 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2020-02-12T14:05:20.475 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2020-02-12T14:05:20.475 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2020-02-12T14:05:20.636 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2020-02-12T14:05:20.772 INFO:teuthology.orchestra.run.smithi139.stdout: Reinstalling : kernel-4.18.0-147.el8.x86_64 1/4 2020-02-12T14:05:20.898 INFO:teuthology.orchestra.run.smithi139.stdout: Reinstalling : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-02-12T14:05:20.898 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : kernel-4.18.0-147.el8.x86_64 3/4 2020-02-12T14:05:20.998 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-4.18.0-147.el8.x86_64 3/4 2020-02-12T14:05:20.999 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-02-12T14:05:21.221 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-02-12T14:05:21.222 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 1/4 2020-02-12T14:05:21.222 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-02-12T14:05:21.222 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 3/4 2020-02-12T14:05:21.444 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 4/4 2020-02-12T14:05:21.444 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:05:21.444 INFO:teuthology.orchestra.run.smithi139.stdout:Reinstalled: 2020-02-12T14:05:21.444 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-4.18.0-147.5.1.el8_1.x86_64 kernel-4.18.0-147.el8.x86_64 2020-02-12T14:05:21.444 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:05:21.444 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2020-02-12T14:05:21.581 INFO:teuthology.orchestra.run.smithi139:> rpm -q kernel --last | head -n 1 2020-02-12T14:05:21.698 INFO:teuthology.orchestra.run.smithi139.stdout:kernel-4.18.0-147.el8.x86_64 Wed 12 Feb 2020 02:05:20 PM UTC 2020-02-12T14:05:21.699 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.el8.x86_64 2020-02-12T14:05:21.699 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-147.5.1.el8_1.x86_64 Expected: 4.18.0-147.el8.x86_64 2020-02-12T14:05:21.700 INFO:teuthology.orchestra.run.smithi072:> uname -r 2020-02-12T14:05:21.716 INFO:teuthology.orchestra.run.smithi072.stdout:4.18.0-147.5.1.el8_1.x86_64 2020-02-12T14:05:21.716 INFO:teuthology.task.kernel:Running kernel on smithi072: 4.18.0-147.5.1.el8_1.x86_64 2020-02-12T14:05:21.716 INFO:teuthology.orchestra.run.smithi072:> sudo yum install -y kernel 2020-02-12T14:05:24.571 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 22:16:25 ago on Tue 11 Feb 2020 03:48:59 PM UTC. 2020-02-12T14:05:25.135 INFO:teuthology.orchestra.run.smithi072.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-02-12T14:05:25.135 INFO:teuthology.orchestra.run.smithi072.stdout:Package kernel-4.18.0-147.5.1.el8_1.x86_64 is already installed. 2020-02-12T14:05:25.328 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2020-02-12T14:05:25.330 INFO:teuthology.orchestra.run.smithi072.stdout:Nothing to do. 2020-02-12T14:05:25.330 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2020-02-12T14:05:25.435 INFO:teuthology.orchestra.run.smithi072:> echo no | sudo yum reinstall kernel || true 2020-02-12T14:05:25.818 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 22:16:26 ago on Tue 11 Feb 2020 03:48:59 PM UTC. 2020-02-12T14:05:26.180 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2020-02-12T14:05:26.180 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2020-02-12T14:05:26.180 INFO:teuthology.orchestra.run.smithi072.stdout: Package Architecture Version Repository Size 2020-02-12T14:05:26.181 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2020-02-12T14:05:26.181 INFO:teuthology.orchestra.run.smithi072.stdout:Reinstalling: 2020-02-12T14:05:26.181 INFO:teuthology.orchestra.run.smithi072.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 BaseOS 1.5 M 2020-02-12T14:05:26.181 INFO:teuthology.orchestra.run.smithi072.stdout: kernel x86_64 4.18.0-147.el8 BaseOS 1.5 M 2020-02-12T14:05:26.181 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:05:26.181 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2020-02-12T14:05:26.181 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2020-02-12T14:05:26.182 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:05:26.182 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 3.1 M 2020-02-12T14:05:26.182 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 0 2020-02-12T14:05:26.183 INFO:teuthology.orchestra.run.smithi072.stderr:Operation aborted. 2020-02-12T14:05:26.287 INFO:teuthology.orchestra.run.smithi072.stdout:Is this ok [y/N]: 2020-02-12T14:05:26.288 INFO:teuthology.orchestra.run.smithi072:> sudo yum reinstall -y kernel || true 2020-02-12T14:05:26.668 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 22:16:27 ago on Tue 11 Feb 2020 03:48:59 PM UTC. 2020-02-12T14:05:27.005 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2020-02-12T14:05:27.006 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2020-02-12T14:05:27.006 INFO:teuthology.orchestra.run.smithi072.stdout: Package Architecture Version Repository Size 2020-02-12T14:05:27.006 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2020-02-12T14:05:27.006 INFO:teuthology.orchestra.run.smithi072.stdout:Reinstalling: 2020-02-12T14:05:27.006 INFO:teuthology.orchestra.run.smithi072.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 BaseOS 1.5 M 2020-02-12T14:05:27.007 INFO:teuthology.orchestra.run.smithi072.stdout: kernel x86_64 4.18.0-147.el8 BaseOS 1.5 M 2020-02-12T14:05:27.007 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:05:27.007 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2020-02-12T14:05:27.007 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2020-02-12T14:05:27.007 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:05:27.008 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 3.1 M 2020-02-12T14:05:27.008 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 0 2020-02-12T14:05:27.008 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2020-02-12T14:05:28.533 INFO:teuthology.orchestra.run.smithi072.stdout:(1/2): kernel-4.18.0-147.5.1.el8_1.x86_64.rpm 7.4 MB/s | 1.5 MB 00:00 2020-02-12T14:05:28.613 INFO:teuthology.orchestra.run.smithi072.stdout:(2/2): kernel-4.18.0-147.el8.x86_64.rpm 5.4 MB/s | 1.5 MB 00:00 2020-02-12T14:05:28.613 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2020-02-12T14:05:28.613 INFO:teuthology.orchestra.run.smithi072.stdout:Total 1.9 MB/s | 3.1 MB 00:01 2020-02-12T14:05:28.632 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2020-02-12T14:05:28.814 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2020-02-12T14:05:28.815 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2020-02-12T14:05:28.886 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2020-02-12T14:05:28.886 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2020-02-12T14:05:29.024 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2020-02-12T14:05:29.194 INFO:teuthology.orchestra.run.smithi072.stdout: Reinstalling : kernel-4.18.0-147.el8.x86_64 1/4 2020-02-12T14:05:29.321 INFO:teuthology.orchestra.run.smithi072.stdout: Reinstalling : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-02-12T14:05:29.321 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : kernel-4.18.0-147.el8.x86_64 3/4 2020-02-12T14:05:29.437 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-4.18.0-147.el8.x86_64 3/4 2020-02-12T14:05:29.437 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-02-12T14:05:29.668 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-02-12T14:05:29.669 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 1/4 2020-02-12T14:05:29.669 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-02-12T14:05:29.669 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 3/4 2020-02-12T14:05:29.880 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 4/4 2020-02-12T14:05:29.880 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:05:29.880 INFO:teuthology.orchestra.run.smithi072.stdout:Reinstalled: 2020-02-12T14:05:29.881 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-4.18.0-147.5.1.el8_1.x86_64 kernel-4.18.0-147.el8.x86_64 2020-02-12T14:05:29.881 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:05:29.881 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2020-02-12T14:05:29.980 INFO:teuthology.orchestra.run.smithi072:> rpm -q kernel --last | head -n 1 2020-02-12T14:05:30.076 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-4.18.0-147.el8.x86_64 Wed 12 Feb 2020 02:05:29 PM UTC 2020-02-12T14:05:30.077 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.el8.x86_64 2020-02-12T14:05:30.077 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-147.5.1.el8_1.x86_64 Expected: 4.18.0-147.el8.x86_64 2020-02-12T14:05:30.077 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2020-02-12T14:05:30.078 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-02-12T14:05:30.078 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-02-12T14:05:30.078 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2020-02-12T14:05:30.078 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi139.front.sepia.ceph.com, path=None, version=distro) 2020-02-12T14:05:30.078 INFO:teuthology.orchestra.run.smithi139:> rpm -q kernel --last | head -n 1 2020-02-12T14:05:30.125 INFO:teuthology.orchestra.run.smithi139.stdout:kernel-4.18.0-147.el8.x86_64 Wed 12 Feb 2020 02:05:20 PM UTC 2020-02-12T14:05:30.127 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.el8.x86_64 2020-02-12T14:05:30.127 INFO:teuthology.orchestra.run.smithi139:> sudo rpm -qi grub2-tools 2020-02-12T14:05:30.161 INFO:teuthology.orchestra.run.smithi139.stdout:Name : grub2-tools 2020-02-12T14:05:30.161 INFO:teuthology.orchestra.run.smithi139.stdout:Epoch : 1 2020-02-12T14:05:30.161 INFO:teuthology.orchestra.run.smithi139.stdout:Version : 2.02 2020-02-12T14:05:30.161 INFO:teuthology.orchestra.run.smithi139.stdout:Release : 78.el8 2020-02-12T14:05:30.161 INFO:teuthology.orchestra.run.smithi139.stdout:Architecture: x86_64 2020-02-12T14:05:30.161 INFO:teuthology.orchestra.run.smithi139.stdout:Install Date: Tue 11 Feb 2020 03:32:52 PM UTC 2020-02-12T14:05:30.161 INFO:teuthology.orchestra.run.smithi139.stdout:Group : System Environment/Base 2020-02-12T14:05:30.162 INFO:teuthology.orchestra.run.smithi139.stdout:Size : 9192691 2020-02-12T14:05:30.162 INFO:teuthology.orchestra.run.smithi139.stdout:License : GPLv3+ 2020-02-12T14:05:30.162 INFO:teuthology.orchestra.run.smithi139.stdout:Signature : RSA/SHA256, Wed 04 Dec 2019 11:50:58 PM UTC, Key ID 05b555b38483c65d 2020-02-12T14:05:30.162 INFO:teuthology.orchestra.run.smithi139.stdout:Source RPM : grub2-2.02-78.el8.src.rpm 2020-02-12T14:05:30.162 INFO:teuthology.orchestra.run.smithi139.stdout:Build Date : Mon 25 Nov 2019 04:08:30 PM UTC 2020-02-12T14:05:30.162 INFO:teuthology.orchestra.run.smithi139.stdout:Build Host : kbuilder.bsys.centos.org 2020-02-12T14:05:30.162 INFO:teuthology.orchestra.run.smithi139.stdout:Relocations : (not relocatable) 2020-02-12T14:05:30.163 INFO:teuthology.orchestra.run.smithi139.stdout:Packager : CentOS BuildSystem 2020-02-12T14:05:30.163 INFO:teuthology.orchestra.run.smithi139.stdout:Vendor : CentOS 2020-02-12T14:05:30.163 INFO:teuthology.orchestra.run.smithi139.stdout:URL : http://www.gnu.org/software/grub/ 2020-02-12T14:05:30.163 INFO:teuthology.orchestra.run.smithi139.stdout:Summary : Support tools for GRUB. 2020-02-12T14:05:30.163 INFO:teuthology.orchestra.run.smithi139.stdout:Description : 2020-02-12T14:05:30.163 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:05:30.163 INFO:teuthology.orchestra.run.smithi139.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2020-02-12T14:05:30.163 INFO:teuthology.orchestra.run.smithi139.stdout:customizable bootloader with modular architecture. It supports a rich 2020-02-12T14:05:30.164 INFO:teuthology.orchestra.run.smithi139.stdout:variety of kernel formats, file systems, computer architectures and 2020-02-12T14:05:30.164 INFO:teuthology.orchestra.run.smithi139.stdout:hardware devices. 2020-02-12T14:05:30.164 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:05:30.164 INFO:teuthology.orchestra.run.smithi139.stdout:This subpackage provides tools for support of all platforms. 2020-02-12T14:05:30.165 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2020-02-12T14:05:30.165 INFO:teuthology.task.kernel:Updating grub on smithi139 to boot 4.18.0-147.el8.x86_64 2020-02-12T14:05:30.165 INFO:teuthology.orchestra.run.smithi139:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2020-02-12T14:05:31.130 INFO:teuthology.orchestra.run.smithi139.stderr:Generating grub configuration file ... 2020-02-12T14:05:33.405 INFO:teuthology.orchestra.run.smithi139.stderr:done 2020-02-12T14:05:33.407 INFO:teuthology.orchestra.run.smithi139:> mktemp 2020-02-12T14:05:33.448 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.iKxbYQzd3B 2020-02-12T14:05:33.449 INFO:teuthology.orchestra.run.smithi139:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.iKxbYQzd3B 2020-02-12T14:05:33.523 INFO:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.iKxbYQzd3B 2020-02-12T14:05:33.677 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.iKxbYQzd3B is 4KB 2020-02-12T14:05:33.728 INFO:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.iKxbYQzd3B 2020-02-12T14:05:33.741 INFO:teuthology.orchestra.run.smithi139:> sudo /bin/ls /boot/loader/entries || true 2020-02-12T14:05:33.824 INFO:teuthology.orchestra.run.smithi139.stdout:64c9091786944d63a01cf35d7b3c4063-0-rescue.conf 2020-02-12T14:05:33.825 INFO:teuthology.orchestra.run.smithi139.stdout:64c9091786944d63a01cf35d7b3c4063-4.18.0-147.5.1.el8_1.x86_64.conf 2020-02-12T14:05:33.825 INFO:teuthology.orchestra.run.smithi139.stdout:64c9091786944d63a01cf35d7b3c4063-4.18.0-147.el8.x86_64.conf 2020-02-12T14:05:33.826 INFO:teuthology.orchestra.run.smithi139:> sudo grub2-set-default 64c9091786944d63a01cf35d7b3c4063-4.18.0-147.el8.x86_64 2020-02-12T14:05:33.999 INFO:teuthology.orchestra.run.smithi139:> sudo shutdown -r now 2020-02-12T14:05:34.001 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2020-02-12T14:05:34.002 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi072.front.sepia.ceph.com, path=None, version=distro) 2020-02-12T14:05:34.002 INFO:teuthology.orchestra.run.smithi072:> rpm -q kernel --last | head -n 1 2020-02-12T14:05:34.048 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-4.18.0-147.el8.x86_64 Wed 12 Feb 2020 02:05:29 PM UTC 2020-02-12T14:05:34.050 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.el8.x86_64 2020-02-12T14:05:34.050 INFO:teuthology.orchestra.run.smithi072:> sudo rpm -qi grub2-tools 2020-02-12T14:05:34.084 INFO:teuthology.orchestra.run.smithi072.stdout:Name : grub2-tools 2020-02-12T14:05:34.085 INFO:teuthology.orchestra.run.smithi072.stdout:Epoch : 1 2020-02-12T14:05:34.085 INFO:teuthology.orchestra.run.smithi072.stdout:Version : 2.02 2020-02-12T14:05:34.085 INFO:teuthology.orchestra.run.smithi072.stdout:Release : 78.el8 2020-02-12T14:05:34.085 INFO:teuthology.orchestra.run.smithi072.stdout:Architecture: x86_64 2020-02-12T14:05:34.085 INFO:teuthology.orchestra.run.smithi072.stdout:Install Date: Tue 11 Feb 2020 03:32:52 PM UTC 2020-02-12T14:05:34.086 INFO:teuthology.orchestra.run.smithi072.stdout:Group : System Environment/Base 2020-02-12T14:05:34.086 INFO:teuthology.orchestra.run.smithi072.stdout:Size : 9192691 2020-02-12T14:05:34.086 INFO:teuthology.orchestra.run.smithi072.stdout:License : GPLv3+ 2020-02-12T14:05:34.086 INFO:teuthology.orchestra.run.smithi072.stdout:Signature : RSA/SHA256, Wed 04 Dec 2019 11:50:58 PM UTC, Key ID 05b555b38483c65d 2020-02-12T14:05:34.086 INFO:teuthology.orchestra.run.smithi072.stdout:Source RPM : grub2-2.02-78.el8.src.rpm 2020-02-12T14:05:34.086 INFO:teuthology.orchestra.run.smithi072.stdout:Build Date : Mon 25 Nov 2019 04:08:30 PM UTC 2020-02-12T14:05:34.087 INFO:teuthology.orchestra.run.smithi072.stdout:Build Host : kbuilder.bsys.centos.org 2020-02-12T14:05:34.087 INFO:teuthology.orchestra.run.smithi072.stdout:Relocations : (not relocatable) 2020-02-12T14:05:34.087 INFO:teuthology.orchestra.run.smithi072.stdout:Packager : CentOS BuildSystem 2020-02-12T14:05:34.087 INFO:teuthology.orchestra.run.smithi072.stdout:Vendor : CentOS 2020-02-12T14:05:34.087 INFO:teuthology.orchestra.run.smithi072.stdout:URL : http://www.gnu.org/software/grub/ 2020-02-12T14:05:34.087 INFO:teuthology.orchestra.run.smithi072.stdout:Summary : Support tools for GRUB. 2020-02-12T14:05:34.087 INFO:teuthology.orchestra.run.smithi072.stdout:Description : 2020-02-12T14:05:34.088 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:05:34.088 INFO:teuthology.orchestra.run.smithi072.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2020-02-12T14:05:34.088 INFO:teuthology.orchestra.run.smithi072.stdout:customizable bootloader with modular architecture. It supports a rich 2020-02-12T14:05:34.088 INFO:teuthology.orchestra.run.smithi072.stdout:variety of kernel formats, file systems, computer architectures and 2020-02-12T14:05:34.088 INFO:teuthology.orchestra.run.smithi072.stdout:hardware devices. 2020-02-12T14:05:34.088 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:05:34.088 INFO:teuthology.orchestra.run.smithi072.stdout:This subpackage provides tools for support of all platforms. 2020-02-12T14:05:34.089 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2020-02-12T14:05:34.089 INFO:teuthology.task.kernel:Updating grub on smithi072 to boot 4.18.0-147.el8.x86_64 2020-02-12T14:05:34.090 INFO:teuthology.orchestra.run.smithi072:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2020-02-12T14:05:34.982 INFO:teuthology.orchestra.run.smithi072.stderr:Generating grub configuration file ... 2020-02-12T14:05:37.163 INFO:teuthology.orchestra.run.smithi072.stderr:done 2020-02-12T14:05:37.164 INFO:teuthology.orchestra.run.smithi072:> mktemp 2020-02-12T14:05:37.192 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.xoFMWhL8rQ 2020-02-12T14:05:37.192 INFO:teuthology.orchestra.run.smithi072:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.xoFMWhL8rQ 2020-02-12T14:05:37.265 INFO:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.xoFMWhL8rQ 2020-02-12T14:05:37.424 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.xoFMWhL8rQ is 4KB 2020-02-12T14:05:37.473 INFO:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.xoFMWhL8rQ 2020-02-12T14:05:37.486 INFO:teuthology.orchestra.run.smithi072:> sudo /bin/ls /boot/loader/entries || true 2020-02-12T14:05:37.551 INFO:teuthology.orchestra.run.smithi072.stdout:64c9091786944d63a01cf35d7b3c4063-0-rescue.conf 2020-02-12T14:05:37.551 INFO:teuthology.orchestra.run.smithi072.stdout:64c9091786944d63a01cf35d7b3c4063-4.18.0-147.5.1.el8_1.x86_64.conf 2020-02-12T14:05:37.551 INFO:teuthology.orchestra.run.smithi072.stdout:64c9091786944d63a01cf35d7b3c4063-4.18.0-147.el8.x86_64.conf 2020-02-12T14:05:37.553 INFO:teuthology.orchestra.run.smithi072:> sudo grub2-set-default 64c9091786944d63a01cf35d7b3c4063-4.18.0-147.el8.x86_64 2020-02-12T14:05:37.693 INFO:teuthology.orchestra.run.smithi072:> sudo shutdown -r now 2020-02-12T14:05:37.696 INFO:teuthology.misc:Re-opening connections... 2020-02-12T14:05:37.696 INFO:teuthology.misc:trying to connect to ubuntu@smithi072.front.sepia.ceph.com 2020-02-12T14:05:37.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T14:05:37.698 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi072.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:05:37.780 INFO:teuthology.orchestra.run.smithi072:> true 2020-02-12T14:05:37.993 DEBUG:teuthology.misc:waited 0.296923875809 2020-02-12T14:05:38.994 INFO:teuthology.misc:trying to connect to ubuntu@smithi139.front.sepia.ceph.com 2020-02-12T14:05:38.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T14:05:38.995 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi139.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:06:38.996 DEBUG:teuthology.orchestra.remote:timed out 2020-02-12T14:06:38.996 DEBUG:teuthology.misc:waited 61.3002607822 2020-02-12T14:06:39.996 INFO:teuthology.misc:trying to connect to ubuntu@smithi139.front.sepia.ceph.com 2020-02-12T14:06:39.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T14:06:39.997 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi139.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:07:11.916 INFO:teuthology.orchestra.run.smithi139:> true 2020-02-12T14:07:12.252 DEBUG:teuthology.misc:waited 94.5559020042 2020-02-12T14:07:13.253 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2020-02-12T14:07:13.253 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-147.el8.x86_64"... 2020-02-12T14:07:13.254 INFO:teuthology.orchestra.run.smithi139:> uname -r 2020-02-12T14:07:13.270 INFO:teuthology.orchestra.run.smithi139.stdout:4.18.0-147.el8.x86_64 2020-02-12T14:07:13.271 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-147.el8.x86_64 vs 4.18.0-147.el8.x86_64 2020-02-12T14:07:13.271 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-02-12T14:07:13.271 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2020-02-12T14:07:13.271 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-147.el8.x86_64"... 2020-02-12T14:07:13.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T14:07:13.272 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi072.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:07:16.330 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2020-02-12T14:07:16.330 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/kernel.py", line 696, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/kernel.py", line 184, in need_to_install stdout=uname_fp, File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 198, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 416, in run raise ConnectionLostError(command=quote(args), node=name) ConnectionLostError: SSH connection to smithi072 was lost: 'uname -r' 2020-02-12T14:07:17.331 INFO:teuthology.misc:Re-opening connections... 2020-02-12T14:07:17.332 INFO:teuthology.misc:trying to connect to ubuntu@smithi072.front.sepia.ceph.com 2020-02-12T14:07:17.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T14:07:17.332 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi072.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:07:19.398 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2020-02-12T14:07:19.398 INFO:teuthology.misc:trying to connect to ubuntu@smithi139.front.sepia.ceph.com 2020-02-12T14:07:19.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T14:07:19.400 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi139.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:07:19.468 INFO:teuthology.orchestra.run.smithi139:> true 2020-02-12T14:07:19.631 DEBUG:teuthology.misc:waited 2.29923200607 2020-02-12T14:07:20.632 INFO:teuthology.misc:trying to connect to ubuntu@smithi072.front.sepia.ceph.com 2020-02-12T14:07:20.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T14:07:20.633 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi072.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:07:22.470 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2020-02-12T14:07:22.470 DEBUG:teuthology.misc:waited 5.13813495636 2020-02-12T14:07:23.471 INFO:teuthology.misc:trying to connect to ubuntu@smithi072.front.sepia.ceph.com 2020-02-12T14:07:23.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T14:07:23.472 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi072.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:07:25.542 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2020-02-12T14:07:25.542 DEBUG:teuthology.misc:waited 8.21029806137 2020-02-12T14:07:26.543 INFO:teuthology.misc:trying to connect to ubuntu@smithi072.front.sepia.ceph.com 2020-02-12T14:07:26.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T14:07:26.543 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi072.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:07:28.242 INFO:teuthology.orchestra.run.smithi072:> true 2020-02-12T14:07:28.585 DEBUG:teuthology.misc:waited 11.2534921169 2020-02-12T14:07:29.586 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2020-02-12T14:07:29.587 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-147.el8.x86_64"... 2020-02-12T14:07:29.587 INFO:teuthology.orchestra.run.smithi072:> uname -r 2020-02-12T14:07:29.611 INFO:teuthology.orchestra.run.smithi072.stdout:4.18.0-147.el8.x86_64 2020-02-12T14:07:29.611 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-147.el8.x86_64 vs 4.18.0-147.el8.x86_64 2020-02-12T14:07:29.611 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-02-12T14:07:30.612 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-02-12T14:07:30.612 INFO:teuthology.orchestra.run.smithi139:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-02-12T14:07:30.726 INFO:teuthology.orchestra.run.smithi139.stdout:ttyS1 2020-02-12T14:07:30.738 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-02-12T14:07:30.738 INFO:teuthology.orchestra.run.smithi072:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-02-12T14:07:30.814 INFO:teuthology.orchestra.run.smithi072.stdout:ttyS1 2020-02-12T14:07:30.826 INFO:teuthology.run_tasks:Running task internal.base... 2020-02-12T14:07:30.837 INFO:teuthology.task.internal:Creating test directory... 2020-02-12T14:07:30.838 INFO:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-02-12T14:07:30.840 INFO:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-02-12T14:07:30.857 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-02-12T14:07:30.868 INFO:teuthology.run_tasks:Running task internal.archive... 2020-02-12T14:07:30.883 INFO:teuthology.task.internal:Creating archive directory... 2020-02-12T14:07:30.883 INFO:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-02-12T14:07:30.896 INFO:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-02-12T14:07:30.919 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-02-12T14:07:30.930 INFO:teuthology.task.internal:Enabling coredump saving... 2020-02-12T14:07:30.930 INFO:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-02-12T14:07:30.963 INFO:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-02-12T14:07:30.995 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-12T14:07:31.003 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-12T14:07:31.010 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-12T14:07:31.018 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-12T14:07:31.020 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-02-12T14:07:31.031 INFO:teuthology.task.internal:Configuring sudo... 2020-02-12T14:07:31.031 INFO:teuthology.orchestra.run.smithi072:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-02-12T14:07:31.055 INFO:teuthology.orchestra.run.smithi139:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-02-12T14:07:31.090 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-02-12T14:07:31.102 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-02-12T14:07:31.102 INFO:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-02-12T14:07:31.123 INFO:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-02-12T14:07:31.145 INFO:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-02-12T14:07:31.213 INFO:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-02-12T14:07:31.270 INFO:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-02-12T14:07:31.345 INFO:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-02-12T14:07:31.394 INFO:teuthology.orchestra.run.smithi072:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-02-12T14:07:31.479 INFO:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-02-12T14:07:31.516 INFO:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-02-12T14:07:31.573 INFO:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-02-12T14:07:31.648 INFO:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-02-12T14:07:31.699 INFO:teuthology.orchestra.run.smithi139:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-02-12T14:07:31.785 INFO:teuthology.orchestra.run.smithi072:> sudo service rsyslog restart 2020-02-12T14:07:31.788 INFO:teuthology.orchestra.run.smithi139:> sudo service rsyslog restart 2020-02-12T14:07:31.889 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-02-12T14:07:31.896 INFO:teuthology.orchestra.run.smithi139.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-02-12T14:07:32.329 INFO:teuthology.run_tasks:Running task internal.timer... 2020-02-12T14:07:32.340 INFO:teuthology.task.internal:Starting timer... 2020-02-12T14:07:32.340 INFO:teuthology.run_tasks:Running task pcp... 2020-02-12T14:07:32.401 INFO:teuthology.run_tasks:Running task selinux... 2020-02-12T14:07:32.448 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2020-02-12T14:07:32.449 INFO:teuthology.orchestra.run.smithi072:> sudo service auditd rotate 2020-02-12T14:07:32.562 INFO:teuthology.orchestra.run.smithi072.stdout:Rotating logs: [ OK ] 2020-02-12T14:07:32.563 INFO:teuthology.orchestra.run.smithi139:> sudo service auditd rotate 2020-02-12T14:07:32.617 INFO:teuthology.orchestra.run.smithi139.stdout:Rotating logs: [ OK ] 2020-02-12T14:07:32.619 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-02-12T14:07:32.619 INFO:teuthology.orchestra.run.smithi072:> /usr/sbin/getenforce 2020-02-12T14:07:32.643 INFO:teuthology.orchestra.run.smithi072.stdout:Permissive 2020-02-12T14:07:32.643 INFO:teuthology.orchestra.run.smithi139:> /usr/sbin/getenforce 2020-02-12T14:07:32.659 INFO:teuthology.orchestra.run.smithi139.stdout:Permissive 2020-02-12T14:07:32.660 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi072.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi139.front.sepia.ceph.com': 'permissive'} 2020-02-12T14:07:32.660 INFO:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-02-12T14:07:32.713 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-02-12T14:07:32.714 INFO:teuthology.orchestra.run.smithi139:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-02-12T14:07:32.742 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-02-12T14:07:32.742 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-02-12T14:07:32.742 INFO:teuthology.orchestra.run.smithi072:> sudo /usr/sbin/setenforce permissive 2020-02-12T14:07:32.796 INFO:teuthology.orchestra.run.smithi139:> sudo /usr/sbin/setenforce permissive 2020-02-12T14:07:32.824 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-02-12T14:07:32.835 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2020-02-12T14:07:32.842 INFO:teuthology.repo_utils:Fetching master from origin 2020-02-12T14:07:32.894 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-02-12T14:07:32.910 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-02-12T14:07:32.912 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi072.front.sepia.ceph.com,smithi139.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-02-12T14:07:33.240 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-02-12T14:07:34.308 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-02-12T14:07:37.024 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-02-12T14:07:37.046 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:37 +0000 (0:00:00.061) 0:00:00.061 **** 2020-02-12T14:07:37.058 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:37 +0000 (0:00:00.011) 0:00:00.072 **** 2020-02-12T14:07:40.490 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi072.front.sepia.ceph.com] 2020-02-12T14:07:40.588 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:40 +0000 (0:00:03.530) 0:00:03.603 **** 2020-02-12T14:07:40.600 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] 2020-02-12T14:07:40.680 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:40 +0000 (0:00:00.092) 0:00:03.695 **** 2020-02-12T14:07:40.912 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-02-12T14:07:40.914 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-02-12T14:07:40.950 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:40 +0000 (0:00:00.270) 0:00:03.965 **** 2020-02-12T14:07:40.957 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-02-12T14:07:40.993 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:40 +0000 (0:00:00.042) 0:00:04.008 **** 2020-02-12T14:07:41.428 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-02-12T14:07:41.429 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-02-12T14:07:41.464 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:41 +0000 (0:00:00.471) 0:00:04.479 **** 2020-02-12T14:07:41.469 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-02-12T14:07:41.506 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:41 +0000 (0:00:00.041) 0:00:04.521 **** 2020-02-12T14:07:41.511 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-02-12T14:07:41.512 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:41.547 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:41 +0000 (0:00:00.040) 0:00:04.562 **** 2020-02-12T14:07:41.552 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:41.588 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:41 +0000 (0:00:00.040) 0:00:04.603 **** 2020-02-12T14:07:41.862 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-02-12T14:07:41.862 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-12T14:07:41.864 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-12T14:07:41.899 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:41 +0000 (0:00:00.311) 0:00:04.915 **** 2020-02-12T14:07:41.931 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:41 +0000 (0:00:00.031) 0:00:04.946 **** 2020-02-12T14:07:42.734 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-02-12T14:07:42.736 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1581516461.94-142511151956900/source", "state": "file", "uid": 0} changed: [smithi072.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1581516461.91-139354039788855/source", "state": "file", "uid": 0} 2020-02-12T14:07:42.772 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:42 +0000 (0:00:00.840) 0:00:05.787 **** 2020-02-12T14:07:42.804 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:42 +0000 (0:00:00.031) 0:00:05.819 **** 2020-02-12T14:07:43.188 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-02-12T14:07:43.189 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-02-12T14:07:43.190 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-02-12T14:07:43.230 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-02-12T14:07:43.232 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-02-12T14:07:43.347 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-02-12T14:07:43.353 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-02-12T14:07:43.551 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:43 +0000 (0:00:00.747) 0:00:06.567 **** 2020-02-12T14:07:43.584 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:43 +0000 (0:00:00.032) 0:00:06.599 **** 2020-02-12T14:07:44.210 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi072.front.sepia.ceph.com] 2020-02-12T14:07:44.292 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-02-12T14:07:44.294 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:44 +0000 (0:00:00.708) 0:00:07.308 **** 2020-02-12T14:07:44.772 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-02-12T14:07:44.774 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.214885", "end": "2020-02-12 14:07:44.752209", "rc": 0, "start": "2020-02-12 14:07:44.537324", "stderr": "", "stderr_lines": [], "stdout": "966e9a6bfb22958c64d4123b47ddee87a2318d5a", "stdout_lines": ["966e9a6bfb22958c64d4123b47ddee87a2318d5a"]} 2020-02-12T14:07:44.810 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:44 +0000 (0:00:00.517) 0:00:07.825 **** 2020-02-12T14:07:45.011 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-02-12T14:07:45.013 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.005355", "end": "2020-02-12 14:07:44.992488", "failed_when_result": false, "rc": 0, "start": "2020-02-12 14:07:44.987133", "stderr": "", "stderr_lines": [], "stdout": "966e9a6bfb22958c64d4123b47ddee87a2318d5a", "stdout_lines": ["966e9a6bfb22958c64d4123b47ddee87a2318d5a"]} 2020-02-12T14:07:45.049 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:45 +0000 (0:00:00.238) 0:00:08.064 **** 2020-02-12T14:07:45.075 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-02-12T14:07:45.077 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-02-12T14:07:45.115 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:45 +0000 (0:00:00.065) 0:00:08.130 **** 2020-02-12T14:07:45.140 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-02-12T14:07:45.142 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.180 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:45 +0000 (0:00:00.065) 0:00:08.195 **** 2020-02-12T14:07:45.206 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-02-12T14:07:45.208 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.251 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:45 +0000 (0:00:00.070) 0:00:08.266 **** 2020-02-12T14:07:45.261 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi139.front.sepia.ceph.com] 2020-02-12T14:07:45.269 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-02-12T14:07:45.271 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.309 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:45 +0000 (0:00:00.055) 0:00:08.322 **** 2020-02-12T14:07:45.343 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-02-12T14:07:45.344 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.380 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:45 +0000 (0:00:00.073) 0:00:08.395 **** 2020-02-12T14:07:45.418 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:45 +0000 (0:00:00.037) 0:00:08.433 **** 2020-02-12T14:07:45.423 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-02-12T14:07:45.425 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.467 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:45 +0000 (0:00:00.049) 0:00:08.482 **** 2020-02-12T14:07:45.518 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.530 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.540 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.542 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.543 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.554 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.555 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.566 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.568 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.580 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.580 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.591 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.593 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.603 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.603 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.614 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.615 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.616 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.627 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.628 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.640 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.641 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.652 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.664 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.665 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.666 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.677 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.679 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.695 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.696 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.698 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.708 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.709 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.710 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.721 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.732 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.733 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.737 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.746 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.747 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.759 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.760 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.772 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.773 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.775 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.786 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.787 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.808 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-02-12T14:07:45.810 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.229748", "end": "2020-02-12 14:07:45.782582", "rc": 0, "start": "2020-02-12 14:07:45.552834", "stderr": "", "stderr_lines": [], "stdout": "966e9a6bfb22958c64d4123b47ddee87a2318d5a", "stdout_lines": ["966e9a6bfb22958c64d4123b47ddee87a2318d5a"]} 2020-02-12T14:07:45.888 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:45 +0000 (0:00:00.420) 0:00:08.903 **** 2020-02-12T14:07:45.894 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-02-12T14:07:45.895 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.897 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.897 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.898 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.900 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.900 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.901 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.903 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.904 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.904 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.906 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.907 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.907 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.919 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.920 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.931 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.953 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.954 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.955 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.966 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.966 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.978 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.989 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:45.989 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.001 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.001 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.012 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.013 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.024 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.025 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.036 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.036 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.047 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.048 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.059 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.059 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.071 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.071 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.083 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.083 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.094 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.096 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-02-12T14:07:46.097 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.007274", "end": "2020-02-12 14:07:46.075376", "failed_when_result": false, "rc": 0, "start": "2020-02-12 14:07:46.068102", "stderr": "", "stderr_lines": [], "stdout": "966e9a6bfb22958c64d4123b47ddee87a2318d5a", "stdout_lines": ["966e9a6bfb22958c64d4123b47ddee87a2318d5a"]} 2020-02-12T14:07:46.097 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-02-12T14:07:46.098 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.143 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:46 +0000 (0:00:00.254) 0:00:09.158 **** 2020-02-12T14:07:46.151 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.152 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.154 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.154 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.155 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.157 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.158 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.159 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.161 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.172 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.172 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.174 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** ok: [smithi139.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-02-12T14:07:46.211 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:46 +0000 (0:00:00.068) 0:00:09.226 **** 2020-02-12T14:07:46.216 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-02-12T14:07:46.216 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.236 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-02-12T14:07:46.238 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.273 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:46 +0000 (0:00:00.061) 0:00:09.288 **** 2020-02-12T14:07:46.310 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:46 +0000 (0:00:00.037) 0:00:09.325 **** 2020-02-12T14:07:46.314 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-02-12T14:07:46.354 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:46 +0000 (0:00:00.043) 0:00:09.369 **** 2020-02-12T14:07:46.359 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-02-12T14:07:46.360 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.400 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:46 +0000 (0:00:00.045) 0:00:09.415 **** 2020-02-12T14:07:46.407 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-02-12T14:07:46.408 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.450 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:46 +0000 (0:00:00.049) 0:00:09.465 **** 2020-02-12T14:07:46.455 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-02-12T14:07:46.457 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.494 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:46 +0000 (0:00:00.044) 0:00:09.509 **** 2020-02-12T14:07:46.499 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-02-12T14:07:46.501 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.541 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:46 +0000 (0:00:00.047) 0:00:09.556 **** 2020-02-12T14:07:46.547 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-02-12T14:07:46.548 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.588 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:46 +0000 (0:00:00.047) 0:00:09.603 **** 2020-02-12T14:07:46.594 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-02-12T14:07:46.595 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.637 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:46 +0000 (0:00:00.048) 0:00:09.652 **** 2020-02-12T14:07:46.642 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.680 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:46 +0000 (0:00:00.042) 0:00:09.695 **** 2020-02-12T14:07:46.694 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.724 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:46 +0000 (0:00:00.044) 0:00:09.739 **** 2020-02-12T14:07:46.730 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-02-12T14:07:46.731 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.732 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.745 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.746 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.747 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.784 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:46 +0000 (0:00:00.060) 0:00:09.799 **** 2020-02-12T14:07:46.792 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.793 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.794 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.796 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0 2020-02-12T14:07:46.797 INFO:teuthology.task.ansible.out:pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp 2020-02-12T14:07:46.799 INFO:teuthology.task.ansible.out:6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.808 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.809 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.820 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.821 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-12T14:07:46.821 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.822 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.822 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-12T14:07:46.823 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.834 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-02-12T14:07:46.835 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi072.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.836 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi072.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.847 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-12T14:07:46.849 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi072.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.850 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.861 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-12T14:07:46.862 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.862 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi072.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.864 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-02-12T14:07:46.866 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.867 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-12T14:07:46.867 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.867 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-02-12T14:07:46.867 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.868 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-12T14:07:46.868 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.879 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-02-12T14:07:46.880 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi072.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi072.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.891 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-02-12T14:07:46.892 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi072.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.893 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi072.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.895 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi072.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.905 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-02-12T14:07:46.907 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi072.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.907 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-12T14:07:46.907 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.918 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.918 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-02-12T14:07:46.919 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.920 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi072.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.921 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi072.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.932 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-02-12T14:07:46.933 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi072.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.935 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi072.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.945 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-12T14:07:46.946 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.948 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi072.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.959 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-12T14:07:46.961 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi072.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.962 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi072.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.973 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.974 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-12T14:07:46.974 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.976 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi072.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.986 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-02-12T14:07:46.988 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi072.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} skipping: [smithi072.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ 2020-02-12T14:07:46.988 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:46.999 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.000 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-12T14:07:47.000 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.001 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** 2020-02-12T14:07:47.002 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.003 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.013 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-12T14:07:47.014 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** 2020-02-12T14:07:47.014 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.016 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi072.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.026 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-02-12T14:07:47.028 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi072.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.029 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi072.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.039 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.039 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-02-12T14:07:47.040 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.041 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi072.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.046 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-02-12T14:07:47.047 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.083 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:47 +0000 (0:00:00.298) 0:00:10.098 **** 2020-02-12T14:07:47.092 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.094 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.095 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.097 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.097 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.099 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.100 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.102 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.114 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.114 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.125 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.126 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.128 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.138 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.140 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.151 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.152 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.164 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.165 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.176 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.187 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.188 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.189 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.200 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.210 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.211 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.223 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.224 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.226 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.237 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.238 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.249 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.250 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.261 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.263 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.283 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.283 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.285 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.295 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.296 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.308 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.309 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.320 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.321 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.332 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.333 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.344 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.344 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.374 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.376 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.377 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.377 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.379 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.393 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.394 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.450 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:47 +0000 (0:00:00.367) 0:00:10.465 **** 2020-02-12T14:07:47.477 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-02-12T14:07:47.514 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:47 +0000 (0:00:00.063) 0:00:10.529 **** 2020-02-12T14:07:47.541 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-02-12T14:07:47.543 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.586 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:47 +0000 (0:00:00.072) 0:00:10.602 **** 2020-02-12T14:07:47.613 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-02-12T14:07:47.614 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.651 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:47 +0000 (0:00:00.064) 0:00:10.666 **** 2020-02-12T14:07:47.676 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-02-12T14:07:47.678 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.713 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:47 +0000 (0:00:00.062) 0:00:10.728 **** 2020-02-12T14:07:47.739 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-02-12T14:07:47.741 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.778 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:47 +0000 (0:00:00.064) 0:00:10.793 **** 2020-02-12T14:07:47.803 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-02-12T14:07:47.805 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.843 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:47 +0000 (0:00:00.064) 0:00:10.858 **** 2020-02-12T14:07:47.858 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-02-12T14:07:47.859 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "checksum": "5b601f2fa82999d906840a797df62d8ddf28ca4b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-02-12T14:07:47.899 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:47 +0000 (0:00:00.056) 0:00:10.914 **** 2020-02-12T14:07:47.911 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-12T14:07:47.913 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.914 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.915 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.917 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.927 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.928 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-02-12T14:07:47.929 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => { "msg": "Host smithi072.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-02-12T14:07:47.963 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:47 +0000 (0:00:00.064) 0:00:10.979 **** 2020-02-12T14:07:47.970 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-12T14:07:47.971 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.973 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.974 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.974 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.976 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.986 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:47.997 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.007 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.019 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-02-12T14:07:48.021 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi139.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.022 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.059 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:48 +0000 (0:00:00.095) 0:00:11.074 **** 2020-02-12T14:07:48.071 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.071 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.073 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.074 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.084 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.085 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-02-12T14:07:48.085 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.085 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-12T14:07:48.085 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.122 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:48 +0000 (0:00:00.063) 0:00:11.137 **** 2020-02-12T14:07:48.129 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.130 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.131 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.132 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.133 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.135 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.145 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.146 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.147 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.157 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.158 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.199 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:48 +0000 (0:00:00.076) 0:00:11.214 **** 2020-02-12T14:07:48.404 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-02-12T14:07:48.404 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.067313", "end": "2020-02-12 14:07:48.375593", "rc": 0, "start": "2020-02-12 14:07:48.308280", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-02-12T14:07:48.442 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:48 +0000 (0:00:00.243) 0:00:11.457 **** 2020-02-12T14:07:48.468 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-02-12T14:07:48.469 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.517 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:48 +0000 (0:00:00.074) 0:00:11.532 **** 2020-02-12T14:07:48.546 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-02-12T14:07:48.548 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.591 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:48 +0000 (0:00:00.073) 0:00:11.606 **** 2020-02-12T14:07:48.623 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-02-12T14:07:48.625 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.669 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:48 +0000 (0:00:00.077) 0:00:11.684 **** 2020-02-12T14:07:48.676 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-02-12T14:07:48.676 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "5b601f2fa82999d906840a797df62d8ddf28ca4b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-02-12T14:07:48.715 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:48 +0000 (0:00:00.046) 0:00:11.731 **** 2020-02-12T14:07:48.721 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-02-12T14:07:48.722 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.760 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:48 +0000 (0:00:00.044) 0:00:11.775 **** 2020-02-12T14:07:48.766 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-02-12T14:07:48.768 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => { "msg": "Host smithi139.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-02-12T14:07:48.809 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:48 +0000 (0:00:00.047) 0:00:11.823 **** 2020-02-12T14:07:48.812 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-02-12T14:07:48.813 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.855 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:48 +0000 (0:00:00.047) 0:00:11.870 **** 2020-02-12T14:07:48.860 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-02-12T14:07:48.862 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-02-12T14:07:48.900 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:48 +0000 (0:00:00.044) 0:00:11.915 **** 2020-02-12T14:07:48.905 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-02-12T14:07:48.907 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.942 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:48 +0000 (0:00:00.042) 0:00:11.957 **** 2020-02-12T14:07:48.947 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-02-12T14:07:48.948 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:48.992 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:48 +0000 (0:00:00.047) 0:00:12.005 **** 2020-02-12T14:07:48.997 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-02-12T14:07:48.997 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-12T14:07:48.998 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-12T14:07:49.035 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:49 +0000 (0:00:00.044) 0:00:12.050 **** 2020-02-12T14:07:49.060 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-02-12T14:07:49.062 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:49.099 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:49 +0000 (0:00:00.064) 0:00:12.114 **** 2020-02-12T14:07:49.125 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-02-12T14:07:49.127 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:49.162 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:49 +0000 (0:00:00.062) 0:00:12.177 **** 2020-02-12T14:07:49.188 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-02-12T14:07:49.190 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-12T14:07:49.224 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:49 +0000 (0:00:00.062) 0:00:12.240 **** 2020-02-12T14:07:49.250 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-02-12T14:07:49.252 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.068908", "end": "2020-02-12 14:07:49.233720", "rc": 0, "start": "2020-02-12 14:07:49.164812", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-02-12T14:07:49.287 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:49 +0000 (0:00:00.062) 0:00:12.302 **** 2020-02-12T14:07:49.321 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:49 +0000 (0:00:00.034) 0:00:12.336 **** 2020-02-12T14:07:49.325 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-02-12T14:07:49.327 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-12T14:07:49.368 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:49 +0000 (0:00:00.047) 0:00:12.384 **** 2020-02-12T14:07:49.373 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-02-12T14:07:49.374 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:49.410 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:49 +0000 (0:00:00.041) 0:00:12.425 **** 2020-02-12T14:07:49.414 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-02-12T14:07:49.416 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:49.452 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:49 +0000 (0:00:00.041) 0:00:12.467 **** 2020-02-12T14:07:49.458 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-02-12T14:07:49.460 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:49.494 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:49 +0000 (0:00:00.042) 0:00:12.509 **** 2020-02-12T14:07:49.498 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-02-12T14:07:49.499 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:49.540 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:49 +0000 (0:00:00.045) 0:00:12.555 **** 2020-02-12T14:07:49.545 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-02-12T14:07:49.546 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:49.583 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:49 +0000 (0:00:00.043) 0:00:12.598 **** 2020-02-12T14:07:49.589 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-02-12T14:07:49.590 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:49.626 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:49 +0000 (0:00:00.042) 0:00:12.641 **** 2020-02-12T14:07:49.631 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-02-12T14:07:49.632 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:49.672 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:49 +0000 (0:00:00.045) 0:00:12.687 **** 2020-02-12T14:07:49.685 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-02-12T14:07:49.686 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:49.721 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:49 +0000 (0:00:00.049) 0:00:12.736 **** 2020-02-12T14:07:49.727 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-02-12T14:07:49.728 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:49.765 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:49 +0000 (0:00:00.043) 0:00:12.780 **** 2020-02-12T14:07:49.770 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-02-12T14:07:49.771 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-12T14:07:49.809 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:49 +0000 (0:00:00.044) 0:00:12.824 **** 2020-02-12T14:07:49.815 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:49.862 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:49 +0000 (0:00:00.053) 0:00:12.877 **** 2020-02-12T14:07:49.867 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-02-12T14:07:49.868 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:49.905 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:49 +0000 (0:00:00.042) 0:00:12.920 **** 2020-02-12T14:07:49.910 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-02-12T14:07:49.910 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-12T14:07:49.911 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-12T14:07:49.947 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:49 +0000 (0:00:00.042) 0:00:12.963 **** 2020-02-12T14:07:49.952 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-02-12T14:07:49.954 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:49.990 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:49 +0000 (0:00:00.041) 0:00:13.005 **** 2020-02-12T14:07:49.996 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-02-12T14:07:49.997 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:50.034 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:50 +0000 (0:00:00.043) 0:00:13.049 **** 2020-02-12T14:07:50.038 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-02-12T14:07:50.040 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:50.076 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:50 +0000 (0:00:00.042) 0:00:13.091 **** 2020-02-12T14:07:50.080 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-02-12T14:07:50.082 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:50.124 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:50 +0000 (0:00:00.047) 0:00:13.139 **** 2020-02-12T14:07:50.129 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-02-12T14:07:50.129 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:50.167 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:50 +0000 (0:00:00.042) 0:00:13.182 **** 2020-02-12T14:07:50.172 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-02-12T14:07:50.173 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-12T14:07:50.209 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:50 +0000 (0:00:00.042) 0:00:13.224 **** 2020-02-12T14:07:50.216 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-02-12T14:07:50.217 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:50.253 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:50 +0000 (0:00:00.043) 0:00:13.268 **** 2020-02-12T14:07:50.258 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-02-12T14:07:50.260 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:50.296 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:50 +0000 (0:00:00.043) 0:00:13.311 **** 2020-02-12T14:07:50.301 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-02-12T14:07:50.301 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:50.340 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:50 +0000 (0:00:00.043) 0:00:13.355 **** 2020-02-12T14:07:50.345 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-02-12T14:07:50.346 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-12T14:07:50.389 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:50 +0000 (0:00:00.048) 0:00:13.404 **** 2020-02-12T14:07:50.393 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-02-12T14:07:50.395 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-12T14:07:50.440 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:50 +0000 (0:00:00.051) 0:00:13.455 **** 2020-02-12T14:07:50.447 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-02-12T14:07:50.448 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:50.484 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:50 +0000 (0:00:00.043) 0:00:13.499 **** 2020-02-12T14:07:50.489 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-02-12T14:07:50.539 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:50 +0000 (0:00:00.054) 0:00:13.554 **** 2020-02-12T14:07:50.546 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-02-12T14:07:50.553 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:50.592 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:50 +0000 (0:00:00.052) 0:00:13.607 **** 2020-02-12T14:07:50.598 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-02-12T14:07:50.599 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:50.640 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:50 +0000 (0:00:00.047) 0:00:13.655 **** 2020-02-12T14:07:50.644 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-02-12T14:07:50.646 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:50.695 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:50 +0000 (0:00:00.055) 0:00:13.710 **** 2020-02-12T14:07:50.722 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-02-12T14:07:50.724 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:50.762 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:50 +0000 (0:00:00.066) 0:00:13.777 **** 2020-02-12T14:07:50.788 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-02-12T14:07:50.790 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-12T14:07:50.827 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:50 +0000 (0:00:00.065) 0:00:13.842 **** 2020-02-12T14:07:50.856 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** ok: [smithi072.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [common : Clean yum cache] ************************************************ skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:50.902 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:50 +0000 (0:00:00.075) 0:00:13.917 **** 2020-02-12T14:07:50.943 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:50 +0000 (0:00:00.040) 0:00:13.958 **** 2020-02-12T14:07:50.970 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-02-12T14:07:50.971 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:51.009 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:51 +0000 (0:00:00.066) 0:00:14.025 **** 2020-02-12T14:07:51.047 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-02-12T14:07:51.048 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:51.089 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:51 +0000 (0:00:00.079) 0:00:14.104 **** 2020-02-12T14:07:51.126 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-02-12T14:07:51.127 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:51.180 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:51 +0000 (0:00:00.091) 0:00:14.196 **** 2020-02-12T14:07:51.218 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-02-12T14:07:51.220 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:51.266 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:51 +0000 (0:00:00.085) 0:00:14.281 **** 2020-02-12T14:07:51.303 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-02-12T14:07:51.304 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:51.349 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:51 +0000 (0:00:00.083) 0:00:14.364 **** 2020-02-12T14:07:51.386 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-02-12T14:07:51.387 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-12T14:07:51.424 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:51 +0000 (0:00:00.074) 0:00:14.439 **** 2020-02-12T14:07:51.430 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-02-12T14:07:51.432 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/8/Everything/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2da7f101e29cfe8f3b630dbd6da82b4f9a749fee", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/8/Everything/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 304, "state": "file", "uid": 0} 2020-02-12T14:07:51.445 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-02-12T14:07:51.484 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:51 +0000 (0:00:00.060) 0:00:14.499 **** 2020-02-12T14:07:51.510 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-02-12T14:07:51.511 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:51.550 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:51 +0000 (0:00:00.065) 0:00:14.565 **** 2020-02-12T14:07:51.785 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-02-12T14:07:51.787 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-12T14:07:51.823 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:51 +0000 (0:00:00.273) 0:00:14.838 **** 2020-02-12T14:07:51.873 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-02-12T14:07:51.873 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/8/Everything/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "ddfaa38799b2dd4c23933a375aa4c3ff61bf7625", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/8/Everything/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 338, "state": "file", "uid": 0} 2020-02-12T14:07:51.913 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:51 +0000 (0:00:00.089) 0:00:14.928 **** 2020-02-12T14:07:52.329 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/8/Everything/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2da7f101e29cfe8f3b630dbd6da82b4f9a749fee", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/8/Everything/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 304, "state": "file", "uid": 0} 2020-02-12T14:07:52.414 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-02-12T14:07:52.416 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-02-12T14:07:52.770 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-02-12T14:07:52.771 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/8/Everything/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "ddfaa38799b2dd4c23933a375aa4c3ff61bf7625", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/8/Everything/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 338, "state": "file", "uid": 0} 2020-02-12T14:07:52.815 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:52 +0000 (0:00:00.901) 0:00:15.830 **** 2020-02-12T14:07:52.863 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-02-12T14:07:52.864 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-02-12T14:07:52.902 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:52 +0000 (0:00:00.087) 0:00:15.917 **** 2020-02-12T14:07:52.929 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:52.965 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:52 +0000 (0:00:00.062) 0:00:15.980 **** 2020-02-12T14:07:52.991 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-02-12T14:07:52.993 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:53.028 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:53 +0000 (0:00:00.063) 0:00:16.043 **** 2020-02-12T14:07:53.056 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-02-12T14:07:53.058 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:53.093 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:53 +0000 (0:00:00.064) 0:00:16.108 **** 2020-02-12T14:07:53.119 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-02-12T14:07:53.120 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:53.157 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:53 +0000 (0:00:00.064) 0:00:16.172 **** 2020-02-12T14:07:53.183 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-02-12T14:07:53.184 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:53.218 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:53 +0000 (0:00:00.061) 0:00:16.233 **** 2020-02-12T14:07:53.255 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-02-12T14:07:53.256 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:53.292 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:53 +0000 (0:00:00.073) 0:00:16.307 **** 2020-02-12T14:07:53.300 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-02-12T14:07:53.300 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-02-12T14:07:53.313 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-02-12T14:07:53.314 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:53.349 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:53 +0000 (0:00:00.056) 0:00:16.364 **** 2020-02-12T14:07:53.375 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-02-12T14:07:53.376 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:53.411 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:53 +0000 (0:00:00.061) 0:00:16.426 **** 2020-02-12T14:07:53.438 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-02-12T14:07:53.440 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:53.474 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:53 +0000 (0:00:00.063) 0:00:16.489 **** 2020-02-12T14:07:53.749 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-02-12T14:07:53.751 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-02-12T14:07:53.788 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:53 +0000 (0:00:00.314) 0:00:16.804 **** 2020-02-12T14:07:53.814 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-02-12T14:07:53.816 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:53.851 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:53 +0000 (0:00:00.062) 0:00:16.866 **** 2020-02-12T14:07:53.877 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-02-12T14:07:53.878 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:53.916 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:53 +0000 (0:00:00.064) 0:00:16.931 **** 2020-02-12T14:07:53.942 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-02-12T14:07:53.943 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:53.979 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:53 +0000 (0:00:00.063) 0:00:16.994 **** 2020-02-12T14:07:54.005 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-02-12T14:07:54.006 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:54.044 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:54 +0000 (0:00:00.065) 0:00:17.059 **** 2020-02-12T14:07:54.071 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-02-12T14:07:54.072 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:54.108 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:54 +0000 (0:00:00.064) 0:00:17.123 **** 2020-02-12T14:07:54.145 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:54.188 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:54 +0000 (0:00:00.078) 0:00:17.202 **** 2020-02-12T14:07:54.213 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-02-12T14:07:54.214 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:54.255 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:54 +0000 (0:00:00.067) 0:00:17.270 **** 2020-02-12T14:07:54.280 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-02-12T14:07:54.282 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:54.319 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:54 +0000 (0:00:00.064) 0:00:17.334 **** 2020-02-12T14:07:54.345 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-02-12T14:07:54.346 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:54.383 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:54 +0000 (0:00:00.063) 0:00:17.397 **** 2020-02-12T14:07:54.523 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-02-12T14:07:54.524 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.860319", "end": "2020-02-12 14:07:54.500326", "rc": 0, "start": "2020-02-12 14:07:53.640007", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T14:07:54.563 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:54 +0000 (0:00:00.181) 0:00:17.578 **** 2020-02-12T14:07:55.530 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.947363", "end": "2020-02-12 14:07:55.500304", "rc": 0, "start": "2020-02-12 14:07:54.552941", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T14:07:55.572 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:55 +0000 (0:00:01.008) 0:00:18.587 **** 2020-02-12T14:07:57.762 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-02-12T14:07:57.804 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:57 +0000 (0:00:02.232) 0:00:20.819 **** 2020-02-12T14:07:57.832 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-02-12T14:07:57.833 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:57.874 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:57 +0000 (0:00:00.070) 0:00:20.889 **** 2020-02-12T14:07:57.901 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-02-12T14:07:57.903 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:57.942 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:57 +0000 (0:00:00.068) 0:00:20.957 **** 2020-02-12T14:07:57.971 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-02-12T14:07:57.972 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:58.011 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:58 +0000 (0:00:00.068) 0:00:21.026 **** 2020-02-12T14:07:58.038 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-02-12T14:07:58.040 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:58.077 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:58 +0000 (0:00:00.066) 0:00:21.092 **** 2020-02-12T14:07:58.396 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-02-12T14:07:58.397 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-02-12T14:07:58.435 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:58 +0000 (0:00:00.357) 0:00:21.450 **** 2020-02-12T14:07:58.461 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-02-12T14:07:58.462 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:58.512 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:58 +0000 (0:00:00.076) 0:00:21.527 **** 2020-02-12T14:07:58.538 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-02-12T14:07:58.539 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Add krb5 config file] ******************************************* ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-02-12T14:07:58.588 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:58 +0000 (0:00:00.076) 0:00:21.603 **** 2020-02-12T14:07:58.638 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:58 +0000 (0:00:00.050) 0:00:21.653 **** 2020-02-12T14:07:58.665 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-02-12T14:07:58.666 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:58.703 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:58 +0000 (0:00:00.064) 0:00:21.718 **** 2020-02-12T14:07:58.729 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-02-12T14:07:58.731 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:07:58.768 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:58 +0000 (0:00:00.065) 0:00:21.784 **** 2020-02-12T14:07:59.229 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-02-12T14:07:59.229 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-02-12T14:07:59.270 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:59 +0000 (0:00:00.500) 0:00:22.285 **** 2020-02-12T14:07:59.485 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-02-12T14:07:59.486 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-02-12T14:07:59.523 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:07:59 +0000 (0:00:00.253) 0:00:22.538 **** 2020-02-12T14:08:00.023 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-02-12T14:08:00.025 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-02-12T14:08:00.155 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-02-12T14:08:00.194 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:00 +0000 (0:00:00.670) 0:00:23.209 **** 2020-02-12T14:08:00.471 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-02-12T14:08:00.473 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-02-12T14:08:00.712 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-02-12T14:08:00.912 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-02-12T14:08:00.952 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:00 +0000 (0:00:00.757) 0:00:23.967 **** 2020-02-12T14:08:01.146 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-02-12T14:08:01.148 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-02-12T14:08:01.184 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:01 +0000 (0:00:00.231) 0:00:24.199 **** 2020-02-12T14:08:01.189 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-02-12T14:08:01.190 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-02-12T14:08:01.612 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-02-12T14:08:01.661 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:01 +0000 (0:00:00.476) 0:00:24.676 **** 2020-02-12T14:08:01.669 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-02-12T14:08:01.669 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-02-12T14:08:01.851 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-02-12T14:08:01.852 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-02-12T14:08:01.891 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:01 +0000 (0:00:00.230) 0:00:24.906 **** 2020-02-12T14:08:02.075 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-02-12T14:08:02.075 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-02-12T14:08:02.348 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-02-12T14:08:02.506 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-02-12T14:08:02.557 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:02 +0000 (0:00:00.665) 0:00:25.572 **** 2020-02-12T14:08:02.583 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-02-12T14:08:02.584 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:08:02.620 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:02 +0000 (0:00:00.063) 0:00:25.636 **** 2020-02-12T14:08:02.657 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-02-12T14:08:02.659 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-02-12T14:08:02.699 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:02 +0000 (0:00:00.078) 0:00:25.714 **** 2020-02-12T14:08:02.778 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-02-12T14:08:02.778 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-02-12T14:08:02.898 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi072.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-02-12T14:08:02.937 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:02 +0000 (0:00:00.238) 0:00:25.952 **** 2020-02-12T14:08:02.974 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-02-12T14:08:02.974 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-12T14:08:02.987 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-12T14:08:02.998 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-12T14:08:03.009 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-12T14:08:03.076 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:03 +0000 (0:00:00.138) 0:00:26.091 **** 2020-02-12T14:08:03.207 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-02-12T14:08:03.208 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-02-12T14:08:03.249 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:03 +0000 (0:00:00.173) 0:00:26.264 **** 2020-02-12T14:08:03.286 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-02-12T14:08:03.288 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:08:03.327 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:03 +0000 (0:00:00.077) 0:00:26.342 **** 2020-02-12T14:08:03.374 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-02-12T14:08:03.375 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-02-12T14:08:03.413 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:03 +0000 (0:00:00.086) 0:00:26.428 **** 2020-02-12T14:08:03.616 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-02-12T14:08:03.617 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-02-12T14:08:03.654 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:03 +0000 (0:00:00.240) 0:00:26.669 **** 2020-02-12T14:08:03.701 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-02-12T14:08:03.702 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-12T14:08:03.712 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-12T14:08:03.713 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-12T14:08:03.724 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-12T14:08:03.764 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:03 +0000 (0:00:00.109) 0:00:26.778 **** 2020-02-12T14:08:03.979 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-02-12T14:08:03.980 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-02-12T14:08:04.019 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:04 +0000 (0:00:00.256) 0:00:27.034 **** 2020-02-12T14:08:04.046 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2020-02-12T14:08:04.048 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:08:04.084 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:04 +0000 (0:00:00.064) 0:00:27.099 **** 2020-02-12T14:08:04.561 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-02-12T14:08:04.561 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-02-12T14:08:04.602 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:04 +0000 (0:00:00.517) 0:00:27.617 **** 2020-02-12T14:08:04.671 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-02-12T14:08:04.672 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-02-12T14:08:04.711 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:04 +0000 (0:00:00.109) 0:00:27.726 **** 2020-02-12T14:08:04.748 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2020-02-12T14:08:04.750 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:08:04.787 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:04 +0000 (0:00:00.076) 0:00:27.802 **** 2020-02-12T14:08:05.087 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-02-12T14:08:05.093 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-02-12T14:08:05.136 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:05 +0000 (0:00:00.348) 0:00:28.151 **** 2020-02-12T14:08:05.166 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-02-12T14:08:05.167 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:08:05.205 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:05 +0000 (0:00:00.068) 0:00:28.220 **** 2020-02-12T14:08:05.253 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-02-12T14:08:05.254 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-02-12T14:08:05.294 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:05 +0000 (0:00:00.089) 0:00:28.309 **** 2020-02-12T14:08:05.418 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-02-12T14:08:05.418 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-12T14:08:05.465 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:05 +0000 (0:00:00.171) 0:00:28.481 **** 2020-02-12T14:08:05.731 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-02-12T14:08:05.732 INFO:teuthology.task.ansible.out:fatal: [smithi072.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-02-12T14:08:05.770 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:05 +0000 (0:00:00.304) 0:00:28.785 **** 2020-02-12T14:08:05.786 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-02-12T14:08:05.787 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-02-12T14:08:05.825 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:05 +0000 (0:00:00.054) 0:00:28.840 **** 2020-02-12T14:08:05.830 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-02-12T14:08:05.832 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:08:05.869 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:05 +0000 (0:00:00.043) 0:00:28.884 **** 2020-02-12T14:08:05.875 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-02-12T14:08:05.876 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:08:05.915 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:05 +0000 (0:00:00.045) 0:00:28.929 **** 2020-02-12T14:08:06.117 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-02-12T14:08:06.119 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-12T14:08:06.156 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:06 +0000 (0:00:00.241) 0:00:29.171 **** 2020-02-12T14:08:06.338 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-02-12T14:08:06.338 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-02-12T14:08:06.378 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:06 +0000 (0:00:00.221) 0:00:29.393 **** 2020-02-12T14:08:06.426 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-02-12T14:08:06.429 INFO:teuthology.task.ansible.out:fatal: [smithi139.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-02-12T14:08:06.464 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:06 +0000 (0:00:00.086) 0:00:29.479 **** 2020-02-12T14:08:06.490 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-02-12T14:08:06.492 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:08:06.528 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:06 +0000 (0:00:00.064) 0:00:29.543 **** 2020-02-12T14:08:07.002 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-02-12T14:08:07.003 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-02-12T14:08:07.040 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:07 +0000 (0:00:00.511) 0:00:30.055 **** 2020-02-12T14:08:07.099 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-02-12T14:08:07.101 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2020-02-12 14:07:24 UTC", "ActiveEnterTimestampMonotonic": "12029139", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "var-run.mount tmp.mount systemd-journald.socket basic.target nss-lookup.target systemd-tmpfiles-setup.service sysinit.target local-fs.target -.mount system.slice time-sync.target network.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2020-02-12 14:07:24 UTC", "AssertTimestampMonotonic": "12028160", "Before": "xdm.service plymouth-quit.service getty@tty1.service shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2020-02-12 14:07:24 UTC", "ConditionTimestampMonotonic": "12028160", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-02-12T14:08:07.103 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2379", "ExecMainStartTimestamp": "Wed 2020-02-12 14:07:24 UTC", "ExecMainStartTimestampMonotonic": "12029111", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Wed 2020-02-12 14:07:24 UTC] ; stop_time=[n/a] ; pid=2379 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2020-02-12 14:07:24 UTC", "InactiveExitTimestampMonotonic": "12029139", "InvocationID": "18b1e3175dd143cd806a0497f9ed4e3b", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-02-12T14:08:07.104 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127435", "LimitNPROCSoft": "127435", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127435", "LimitSIGPENDINGSoft": "127435", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2379", "MemoryAccounting": "yes", "MemoryCurrent": "1609728", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-02-12T14:08:07.106 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2020-02-12 14:07:24 UTC", "StateChangeTimestampMonotonic": "12029139", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2020-02-12 14:07:24 UTC", "WatchdogTimestampMonotonic": "12029138", "WatchdogUSec": "0"}} 2020-02-12T14:08:07.140 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:07 +0000 (0:00:00.100) 0:00:30.155 **** 2020-02-12T14:08:07.335 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-02-12T14:08:07.336 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001737", "end": "2020-02-12 14:08:07.311754", "rc": 0, "start": "2020-02-12 14:08:07.310017", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-02-12T14:08:07.381 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:07 +0000 (0:00:00.240) 0:00:30.396 **** 2020-02-12T14:08:07.387 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-02-12T14:08:07.391 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2020-02-12 14:07:06 UTC", "ActiveEnterTimestampMonotonic": "12113792", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "time-sync.target sysinit.target systemd-journald.socket network.target var-run.mount -.mount tmp.mount systemd-tmpfiles-setup.service nss-lookup.target system.slice basic.target local-fs.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2020-02-12 14:07:06 UTC", "AssertTimestampMonotonic": "12113023", "Before": "xdm.service plymouth-quit.service shutdown.target multi-user.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2020-02-12 14:07:06 UTC", "ConditionTimestampMonotonic": "12113023", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-02-12T14:08:07.392 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2386", "ExecMainStartTimestamp": "Wed 2020-02-12 14:07:06 UTC", "ExecMainStartTimestampMonotonic": "12113759", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Wed 2020-02-12 14:07:06 UTC] ; stop_time=[n/a] ; pid=2386 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2020-02-12 14:07:06 UTC", "InactiveExitTimestampMonotonic": "12113792", "InvocationID": "3224e0432333466da7d064c16534ccf2", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-02-12T14:08:07.394 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127436", "LimitNPROCSoft": "127436", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127436", "LimitSIGPENDINGSoft": "127436", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2386", "MemoryAccounting": "yes", "MemoryCurrent": "1576960", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-02-12T14:08:07.395 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2020-02-12 14:07:06 UTC", "StateChangeTimestampMonotonic": "12113792", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTY 2020-02-12T14:08:07.395 INFO:teuthology.task.ansible.out:VHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2020-02-12 14:07:06 UTC", "WatchdogTimestampMonotonic": "12113791", "WatchdogUSec": "0"}} 2020-02-12T14:08:07.440 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:07 +0000 (0:00:00.058) 0:00:30.455 **** 2020-02-12T14:08:07.634 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-02-12T14:08:07.635 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001738", "end": "2020-02-12 14:08:07.615029", "rc": 0, "start": "2020-02-12 14:08:07.613291", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-02-12T14:08:07.681 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:07 +0000 (0:00:00.240) 0:00:30.696 **** 2020-02-12T14:08:08.289 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-02-12T14:08:08.291 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-02-12T14:08:08.331 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:08 +0000 (0:00:00.650) 0:00:31.346 **** 2020-02-12T14:08:08.568 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-02-12T14:08:08.606 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:08 +0000 (0:00:00.274) 0:00:31.621 **** 2020-02-12T14:08:09.228 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-02-12T14:08:09.230 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-02-12T14:08:09.270 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:09 +0000 (0:00:00.663) 0:00:32.285 **** 2020-02-12T14:08:09.504 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-02-12T14:08:09.542 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:09 +0000 (0:00:00.272) 0:00:32.557 **** 2020-02-12T14:08:10.735 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-02-12T14:08:10.735 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-02-12T14:08:10.775 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:10 +0000 (0:00:01.232) 0:00:33.790 **** 2020-02-12T14:08:10.781 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-02-12T14:08:10.821 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:10 +0000 (0:00:00.046) 0:00:33.837 **** 2020-02-12T14:08:27.152 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-02-12T14:08:27.153 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.140401", "end": "2020-02-12 14:08:27.130464", "failed_when_result": false, "rc": 0, "start": "2020-02-12 14:08:10.990063", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-02-12T14:08:27.187 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:27 +0000 (0:00:16.365) 0:00:50.202 **** 2020-02-12T14:08:27.193 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.193400", "end": "2020-02-12 14:08:27.140033", "failed_when_result": false, "rc": 0, "start": "2020-02-12 14:08:10.946633", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-02-12T14:08:27.235 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:27 +0000 (0:00:00.047) 0:00:50.250 **** 2020-02-12T14:08:27.646 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-02-12T14:08:27.647 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-02-12T14:08:27.689 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:27 +0000 (0:00:00.454) 0:00:50.704 **** 2020-02-12T14:08:27.705 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-02-12T14:08:27.743 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:27 +0000 (0:00:00.053) 0:00:50.758 **** 2020-02-12T14:08:27.906 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-02-12T14:08:27.909 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.027872", "end": "2020-02-12 14:08:27.886798", "rc": 0, "start": "2020-02-12 14:08:27.858926", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T14:08:27.944 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:27 +0000 (0:00:00.200) 0:00:50.959 **** 2020-02-12T14:08:27.949 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.013572", "end": "2020-02-12 14:08:27.926725", "rc": 0, "start": "2020-02-12 14:08:27.913153", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T14:08:27.990 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:27 +0000 (0:00:00.046) 0:00:51.006 **** 2020-02-12T14:08:28.137 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-02-12T14:08:28.138 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002118", "end": "2020-02-12 14:08:28.118568", "rc": 0, "start": "2020-02-12 14:08:28.116450", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T14:08:28.173 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:28 +0000 (0:00:00.182) 0:00:51.188 **** 2020-02-12T14:08:28.190 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002287", "end": "2020-02-12 14:08:28.163354", "rc": 0, "start": "2020-02-12 14:08:28.161067", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T14:08:28.228 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:28 +0000 (0:00:00.054) 0:00:51.243 **** 2020-02-12T14:08:44.373 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-02-12T14:08:44.374 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.003565", "end": "2020-02-12 14:08:44.346541", "rc": 0, "start": "2020-02-12 14:08:28.342976", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T14:08:44.411 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:44 +0000 (0:00:16.183) 0:01:07.426 **** 2020-02-12T14:08:44.439 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.022279", "end": "2020-02-12 14:08:44.419261", "rc": 0, "start": "2020-02-12 14:08:28.396982", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T14:08:44.479 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:44 +0000 (0:00:00.067) 0:01:07.494 **** 2020-02-12T14:08:44.609 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-02-12T14:08:44.610 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-02-12T14:08:44.647 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:44 +0000 (0:00:00.167) 0:01:07.662 **** 2020-02-12T14:08:44.673 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-02-12T14:08:44.675 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-02-12T14:08:44.714 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:44 +0000 (0:00:00.066) 0:01:07.729 **** 2020-02-12T14:08:44.753 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:44 +0000 (0:00:00.039) 0:01:07.768 **** 2020-02-12T14:08:44.758 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-02-12T14:08:44.758 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-02-12T14:08:44.801 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:44 +0000 (0:00:00.047) 0:01:07.816 **** 2020-02-12T14:08:44.807 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-02-12T14:08:44.808 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-02-12T14:08:44.846 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:44 +0000 (0:00:00.044) 0:01:07.861 **** 2020-02-12T14:08:44.850 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-02-12T14:08:44.851 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["@core", "@base", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-02-12T14:08:44.894 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:44 +0000 (0:00:00.046) 0:01:07.908 **** 2020-02-12T14:08:44.898 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-02-12T14:08:44.898 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-02-12T14:08:44.938 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:44 +0000 (0:00:00.044) 0:01:07.953 **** 2020-02-12T14:08:44.943 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-02-12T14:08:44.944 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-02-12T14:08:44.985 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:44 +0000 (0:00:00.047) 0:01:08.000 **** 2020-02-12T14:08:44.990 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-02-12T14:08:44.991 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["@core", "@base", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-02-12T14:08:45.034 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:45 +0000 (0:00:00.048) 0:01:08.049 **** 2020-02-12T14:08:45.076 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-02-12T14:08:45.077 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-02-12T14:08:45.114 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:45 +0000 (0:00:00.079) 0:01:08.129 **** 2020-02-12T14:08:45.175 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-02-12T14:08:45.176 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-02-12T14:08:45.212 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:45 +0000 (0:00:00.098) 0:01:08.227 **** 2020-02-12T14:08:45.323 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-02-12T14:08:45.363 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:45 +0000 (0:00:00.150) 0:01:08.378 **** 2020-02-12T14:08:45.410 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-02-12T14:08:45.411 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "gid": 1209, "name": "ubuntu", "state": "present", "system": false} 2020-02-12T14:08:45.450 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:45 +0000 (0:00:00.086) 0:01:08.465 **** 2020-02-12T14:08:45.477 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-02-12T14:08:45.478 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:08:45.516 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:45 +0000 (0:00:00.065) 0:01:08.531 **** 2020-02-12T14:08:45.542 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-02-12T14:08:45.543 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:08:45.581 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:45 +0000 (0:00:00.065) 0:01:08.596 **** 2020-02-12T14:08:45.586 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-02-12T14:08:45.587 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "gid": 1209, "name": "ubuntu", "state": "present", "system": false} 2020-02-12T14:08:45.629 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:45 +0000 (0:00:00.048) 0:01:08.644 **** 2020-02-12T14:08:45.655 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-02-12T14:08:45.656 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:08:45.693 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:45 +0000 (0:00:00.063) 0:01:08.708 **** 2020-02-12T14:08:45.719 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-02-12T14:08:45.720 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:08:45.756 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:45 +0000 (0:00:00.063) 0:01:08.771 **** 2020-02-12T14:08:45.793 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-02-12T14:08:45.793 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-02-12T14:08:45.832 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:45 +0000 (0:00:00.075) 0:01:08.847 **** 2020-02-12T14:08:45.975 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-02-12T14:08:46.036 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:46 +0000 (0:00:00.203) 0:01:09.051 **** 2020-02-12T14:08:46.377 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-02-12T14:08:46.379 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-02-12T14:08:46.416 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:46 +0000 (0:00:00.380) 0:01:09.432 **** 2020-02-12T14:08:46.453 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-02-12T14:08:46.455 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi072"}, "changed": false} 2020-02-12T14:08:46.494 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:46 +0000 (0:00:00.077) 0:01:09.509 **** 2020-02-12T14:08:46.595 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-02-12T14:08:46.596 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-02-12T14:08:46.659 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:46 +0000 (0:00:00.165) 0:01:09.674 **** 2020-02-12T14:08:46.689 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-02-12T14:08:46.691 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi139"}, "changed": false} 2020-02-12T14:08:46.728 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:46 +0000 (0:00:00.069) 0:01:09.743 **** 2020-02-12T14:08:47.462 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-02-12T14:08:47.463 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi139.front.sepia.ceph.com", "ansible_hostname": "smithi139", "ansible_nodename": "smithi139"}, "changed": true, "name": "smithi139"} 2020-02-12T14:08:47.465 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi072.front.sepia.ceph.com", "ansible_hostname": "smithi072", "ansible_nodename": "smithi072"}, "changed": true, "name": "smithi072"} 2020-02-12T14:08:47.503 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:47 +0000 (0:00:00.775) 0:01:10.518 **** 2020-02-12T14:08:47.537 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:47 +0000 (0:00:00.033) 0:01:10.552 **** 2020-02-12T14:08:47.970 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-02-12T14:08:47.970 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-02-12T14:08:48.011 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:48 +0000 (0:00:00.473) 0:01:11.026 **** 2020-02-12T14:08:48.018 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-02-12T14:08:48.060 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:48 +0000 (0:00:00.048) 0:01:11.075 **** 2020-02-12T14:08:48.470 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-02-12T14:08:48.470 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-02-12T14:08:48.512 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:48 +0000 (0:00:00.452) 0:01:11.527 **** 2020-02-12T14:08:48.517 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-02-12T14:08:48.561 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:48 +0000 (0:00:00.049) 0:01:11.576 **** 2020-02-12T14:08:49.100 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-02-12T14:08:49.101 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-02-12T14:08:49.138 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:49 +0000 (0:00:00.576) 0:01:12.153 **** 2020-02-12T14:08:49.241 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-02-12T14:08:49.281 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:49 +0000 (0:00:00.142) 0:01:12.296 **** 2020-02-12T14:08:49.609 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-02-12T14:08:49.609 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-02-12T14:08:49.649 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:49 +0000 (0:00:00.367) 0:01:12.664 **** 2020-02-12T14:08:49.752 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-02-12T14:08:49.791 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:49 +0000 (0:00:00.142) 0:01:12.806 **** 2020-02-12T14:08:49.850 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-02-12T14:08:49.851 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-02-12T14:08:49.891 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:49 +0000 (0:00:00.100) 0:01:12.906 **** 2020-02-12T14:08:50.002 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-02-12T14:08:50.048 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:50 +0000 (0:00:00.156) 0:01:13.063 **** 2020-02-12T14:08:50.095 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-02-12T14:08:50.097 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-02-12T14:08:50.144 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:50 +0000 (0:00:00.095) 0:01:13.159 **** 2020-02-12T14:08:50.244 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-02-12T14:08:50.287 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:50 +0000 (0:00:00.142) 0:01:13.302 **** 2020-02-12T14:08:50.590 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-02-12T14:08:50.592 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1209, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-02-12T14:08:50.629 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:50 +0000 (0:00:00.342) 0:01:13.644 **** 2020-02-12T14:08:50.636 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1209, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-02-12T14:08:50.675 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:50 +0000 (0:00:00.045) 0:01:13.690 **** 2020-02-12T14:08:51.122 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-02-12T14:08:51.123 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-02-12T14:08:51.161 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:51 +0000 (0:00:00.486) 0:01:14.177 **** 2020-02-12T14:08:51.167 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-02-12T14:08:51.207 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:51 +0000 (0:00:00.045) 0:01:14.222 **** 2020-02-12T14:08:51.651 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-02-12T14:08:51.651 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-02-12T14:08:51.694 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:51 +0000 (0:00:00.487) 0:01:14.709 **** 2020-02-12T14:08:51.702 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-02-12T14:08:51.742 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:51 +0000 (0:00:00.048) 0:01:14.758 **** 2020-02-12T14:08:53.549 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-02-12T14:08:53.550 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-02-12T14:08:53.551 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.652033", "end": "2020-02-12 14:08:53.517607", "rc": 0, "start": "2020-02-12 14:08:51.865574", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T14:08:53.590 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:53 +0000 (0:00:01.847) 0:01:16.605 **** 2020-02-12T14:08:53.599 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.638918", "end": "2020-02-12 14:08:53.551645", "rc": 0, "start": "2020-02-12 14:08:51.912727", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T14:08:53.643 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:53 +0000 (0:00:00.052) 0:01:16.658 **** 2020-02-12T14:08:54.100 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-02-12T14:08:54.101 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-02-12T14:08:54.147 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:54 +0000 (0:00:00.504) 0:01:17.163 **** 2020-02-12T14:08:54.154 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-02-12T14:08:54.196 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:54 +0000 (0:00:00.048) 0:01:17.211 **** 2020-02-12T14:08:54.202 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-02-12T14:08:54.245 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:54 +0000 (0:00:00.049) 0:01:17.261 **** 2020-02-12T14:08:54.289 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:54 +0000 (0:00:00.043) 0:01:17.304 **** 2020-02-12T14:08:54.972 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-02-12T14:08:54.974 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.522147", "end": "2020-02-12 14:08:54.947565", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-02-12 14:08:54.425418", "stderr": "", "stderr_lines": [], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} [WARNING]: Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-02-12T14:08:55.011 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:55 +0000 (0:00:00.721) 0:01:18.026 **** 2020-02-12T14:08:55.017 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.518865", "end": "2020-02-12 14:08:54.988033", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-02-12 14:08:54.469168", "stderr": "", "stderr_lines": [], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2020-02-12T14:08:55.056 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:55 +0000 (0:00:00.045) 0:01:18.071 **** 2020-02-12T14:08:55.061 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-02-12T14:08:55.063 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:08:55.101 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:55 +0000 (0:00:00.045) 0:01:18.117 **** 2020-02-12T14:08:55.107 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:08:55.150 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:55 +0000 (0:00:00.048) 0:01:18.165 **** 2020-02-12T14:08:55.154 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-02-12T14:08:55.155 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-02-12T14:08:55.156 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-02-12T14:08:55.202 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:55 +0000 (0:00:00.051) 0:01:18.217 **** 2020-02-12T14:08:55.208 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-02-12T14:08:55.209 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-02-12T14:08:55.248 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:55 +0000 (0:00:00.046) 0:01:18.263 **** 2020-02-12T14:08:55.253 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-02-12T14:08:55.253 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:08:55.292 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:55 +0000 (0:00:00.043) 0:01:18.306 **** 2020-02-12T14:08:55.298 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:08:55.342 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:55 +0000 (0:00:00.050) 0:01:18.357 **** 2020-02-12T14:08:55.347 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-12T14:08:55.348 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-02-12T14:08:55.400 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:55 +0000 (0:00:00.057) 0:01:18.415 **** 2020-02-12T14:08:55.405 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-02-12T14:08:55.452 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:55 +0000 (0:00:00.052) 0:01:18.467 **** 2020-02-12T14:08:55.457 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-02-12T14:08:55.458 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:08:55.496 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:55 +0000 (0:00:00.044) 0:01:18.511 **** 2020-02-12T14:08:55.502 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:08:55.546 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:55 +0000 (0:00:00.049) 0:01:18.561 **** 2020-02-12T14:08:55.554 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-02-12T14:08:55.556 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:08:55.605 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:55 +0000 (0:00:00.058) 0:01:18.620 **** 2020-02-12T14:08:55.610 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:08:55.653 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:55 +0000 (0:00:00.048) 0:01:18.668 **** 2020-02-12T14:08:55.816 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-02-12T14:08:55.817 INFO:teuthology.task.ansible.out:fatal: [smithi072.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006609", "end": "2020-02-12 14:08:55.790234", "msg": "non-zero return code", "rc": 1, "start": "2020-02-12 14:08:55.783625", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-02-12T14:08:55.854 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:55 +0000 (0:00:00.200) 0:01:18.869 **** 2020-02-12T14:08:55.871 INFO:teuthology.task.ansible.out:fatal: [smithi139.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006418", "end": "2020-02-12 14:08:55.843741", "msg": "non-zero return code", "rc": 1, "start": "2020-02-12 14:08:55.837323", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-02-12T14:08:55.909 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:55 +0000 (0:00:00.055) 0:01:18.924 **** 2020-02-12T14:08:55.914 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-02-12T14:08:55.915 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:08:55.961 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:55 +0000 (0:00:00.051) 0:01:18.976 **** 2020-02-12T14:08:55.971 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:08:56.007 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:56 +0000 (0:00:00.046) 0:01:19.022 **** 2020-02-12T14:08:58.981 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-02-12T14:08:58.981 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-02-12T14:08:59.019 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:59 +0000 (0:00:03.011) 0:01:22.034 **** 2020-02-12T14:08:59.025 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-02-12T14:08:59.064 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:08:59 +0000 (0:00:00.044) 0:01:22.079 **** 2020-02-12T14:09:02.048 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-02-12T14:09:02.048 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64", "Removed: hdparm-9.54-2.el8.x86_64", "Removed: tuned-2.12.0-3.el8_1.1.noarch"]} 2020-02-12T14:09:02.087 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:02 +0000 (0:00:03.023) 0:01:25.102 **** 2020-02-12T14:09:02.402 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64", "Removed: hdparm-9.54-2.el8.x86_64", "Removed: tuned-2.12.0-3.el8_1.1.noarch"]} 2020-02-12T14:09:02.441 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:02 +0000 (0:00:00.349) 0:01:25.452 **** 2020-02-12T14:09:07.952 INFO:teuthology.task.ansible.out: TASK [testnode : Base group workaround for BZ1782899] ************************** 2020-02-12T14:09:07.953 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => {"changed": true, "cmd": "dnf -y groupinstall base --nobest && dnf -y group upgrade base", "delta": "0:00:05.642395", "end": "2020-02-12 14:09:07.924755", "rc": 0, "start": "2020-02-12 14:09:02.282360", "stderr": "No match for group package \"insights-client\"\nNo match for group package \"centos-release-eula\"\nNo match for group package \"centos-release-eula\"\nNo match for group package \"insights-client\"", "stderr_lines": ["No match for group package \"insights-client\"", "No match for group package \"centos-release-eula\"", "No match for group package \"centos-release-eula\"", "No match for group package \"insights-client\""], "stdout": "CentOS-8 - AppStream 18 kB/s | 4.3 kB 00:00 \nCentOS-8 - Base 15 kB/s | 3.8 kB 00:00 \nCentOS-8 - Extras 3.5 kB/s | 1.5 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 15 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 166 kB/s | 5.3 kB 00:00 \nlab-extras 1.0 MB/s | 2.9 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!\nLast metadata expiration check: 0:00:03 ago on Wed 12 Feb 2020 02:09:03 PM UTC.\nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n============================================================= 2020-02-12T14:09:07.954 INFO:teuthology.task.ansible.out:===================\nUpgrading Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!", "stdout_lines": ["CentOS-8 - AppStream 18 kB/s | 4.3 kB 00:00 ", "CentOS-8 - Base 15 kB/s | 3.8 kB 00:00 ", "CentOS-8 - Extras 3.5 kB/s | 1.5 kB 00:00 ", "Copr repo for ceph-el8 owned by ktdreyer 15 kB/s | 3.3 kB 00:00 ", "Extra Packages for Enterprise Linux 166 kB/s | 5.3 kB 00:00 ", "lab-extras 1.0 MB/s | 2.9 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Installing Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!", "Last metadata expiration check: 0:00:03 ago on Wed 12 Feb 2020 02:09:03 PM UTC.", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Upgrading Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!"]} 2020-02-12T14:09:07.992 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:07 +0000 (0:00:05.554) 0:01:31.007 **** 2020-02-12T14:09:08.144 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "cmd": "dnf -y groupinstall base --nobest && dnf -y group upgrade base", "delta": "0:00:05.486284", "end": "2020-02-12 14:09:08.121679", "rc": 0, "start": "2020-02-12 14:09:02.635395", "stderr": "No match for group package \"insights-client\"\nNo match for group package \"centos-release-eula\"\nNo match for group package \"insights-client\"\nNo match for group package \"centos-release-eula\"", "stderr_lines": ["No match for group package \"insights-client\"", "No match for group package \"centos-release-eula\"", "No match for group package \"insights-client\"", "No match for group package \"centos-release-eula\""], "stdout": "CentOS-8 - AppStream 13 kB/s | 4.3 kB 00:00 \nCentOS-8 - Base 9.7 kB/s | 3.8 kB 00:00 \nCentOS-8 - Extras 2.7 kB/s | 1.5 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 32 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 138 kB/s | 5.3 kB 00:00 \nlab-extras 1.1 MB/s | 2.9 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!\nLast metadata expiration check: 0:00:02 ago on Wed 12 Feb 2020 02:09:04 PM UTC.\nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n============================================================= 2020-02-12T14:09:08.146 INFO:teuthology.task.ansible.out:===================\nUpgrading Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!", "stdout_lines": ["CentOS-8 - AppStream 13 kB/s | 4.3 kB 00:00 ", "CentOS-8 - Base 9.7 kB/s | 3.8 kB 00:00 ", "CentOS-8 - Extras 2.7 kB/s | 1.5 kB 00:00 ", "Copr repo for ceph-el8 owned by ktdreyer 32 kB/s | 3.3 kB 00:00 ", "Extra Packages for Enterprise Linux 138 kB/s | 5.3 kB 00:00 ", "lab-extras 1.1 MB/s | 2.9 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Installing Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!", "Last metadata expiration check: 0:00:02 ago on Wed 12 Feb 2020 02:09:04 PM UTC.", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Upgrading Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!"]} 2020-02-12T14:09:08.183 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:08 +0000 (0:00:00.191) 0:01:31.198 **** 2020-02-12T14:09:15.601 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-02-12T14:09:15.602 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Group core installed.", "Group base installed.", "Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: tuned-2.12.0-3.el8_1.1.noarch", "Installed: hdparm-9.54-2.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64", "Installed: boost-random-1.66.0-6.el8.x86_64"]} 2020-02-12T14:09:15.641 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:15 +0000 (0:00:07.457) 0:01:38.656 **** 2020-02-12T14:09:15.651 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Group core installed.", "Group base installed.", "Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: tuned-2.12.0-3.el8_1.1.noarch", "Installed: hdparm-9.54-2.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64", "Installed: boost-random-1.66.0-6.el8.x86_64"]} 2020-02-12T14:09:15.697 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:15 +0000 (0:00:00.055) 0:01:38.712 **** 2020-02-12T14:09:15.703 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-02-12T14:09:15.704 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:15.754 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:15 +0000 (0:00:00.057) 0:01:38.769 **** 2020-02-12T14:09:15.762 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:15.801 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:15 +0000 (0:00:00.047) 0:01:38.817 **** 2020-02-12T14:09:16.674 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-02-12T14:09:16.675 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-02-12T14:09:16.711 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:16 +0000 (0:00:00.909) 0:01:39.726 **** 2020-02-12T14:09:16.729 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-02-12T14:09:16.772 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:16 +0000 (0:00:00.060) 0:01:39.787 **** 2020-02-12T14:09:16.778 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-02-12T14:09:16.779 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:16.816 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:16 +0000 (0:00:00.044) 0:01:39.832 **** 2020-02-12T14:09:16.822 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:16.860 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:16 +0000 (0:00:00.043) 0:01:39.875 **** 2020-02-12T14:09:17.125 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-02-12T14:09:17.127 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target sysinit.target dbus.service system.slice polkit.service dbus.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ipset.service ebtables.service ip6tables.service shutdown.target iptables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-02-12T14:09:17.129 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127436", "LimitNPROCSoft": "127436", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127436", 2020-02-12T14:09:17.130 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127436", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target dbus.socket", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-02-12T14:09:17.132 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-02-12T14:09:17.169 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:17 +0000 (0:00:00.309) 0:01:40.184 **** 2020-02-12T14:09:17.178 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "polkit.service dbus.service system.slice basic.target dbus.socket sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ebtables.service ipset.service shutdown.target ip6tables.service iptables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-02-12T14:09:17.179 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127435", "LimitNPROCSoft": "127435", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127435", 2020-02-12T14:09:17.181 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127435", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "dbus.socket system.slice sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-02-12T14:09:17.182 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-02-12T14:09:17.217 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:17 +0000 (0:00:00.047) 0:01:40.232 **** 2020-02-12T14:09:17.460 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-02-12T14:09:17.462 INFO:teuthology.task.ansible.out:fatal: [smithi139.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-02-12T14:09:17.497 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:17 +0000 (0:00:00.280) 0:01:40.512 **** 2020-02-12T14:09:17.513 INFO:teuthology.task.ansible.out:fatal: [smithi072.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-02-12T14:09:17.551 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:17 +0000 (0:00:00.053) 0:01:40.566 **** 2020-02-12T14:09:18.184 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-02-12T14:09:18.186 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-02-12T14:09:18.222 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:18 +0000 (0:00:00.671) 0:01:41.237 **** 2020-02-12T14:09:18.256 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:18 +0000 (0:00:00.033) 0:01:41.271 **** 2020-02-12T14:09:18.261 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-02-12T14:09:18.262 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:18.300 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:18 +0000 (0:00:00.043) 0:01:41.315 **** 2020-02-12T14:09:18.306 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:18.343 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:18 +0000 (0:00:00.043) 0:01:41.359 **** 2020-02-12T14:09:18.351 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-02-12T14:09:18.387 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:18 +0000 (0:00:00.043) 0:01:41.403 **** 2020-02-12T14:09:18.432 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:18 +0000 (0:00:00.044) 0:01:41.447 **** 2020-02-12T14:09:18.437 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-02-12T14:09:18.439 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:18.479 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:18 +0000 (0:00:00.046) 0:01:41.494 **** 2020-02-12T14:09:18.484 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:18.521 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:18 +0000 (0:00:00.042) 0:01:41.537 **** 2020-02-12T14:09:18.526 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-02-12T14:09:18.526 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:18.564 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:18 +0000 (0:00:00.042) 0:01:41.579 **** 2020-02-12T14:09:18.570 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:18.613 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:18 +0000 (0:00:00.049) 0:01:41.628 **** 2020-02-12T14:09:18.618 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-02-12T14:09:18.618 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-02-12T14:09:18.620 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-02-12T14:09:18.657 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:18 +0000 (0:00:00.043) 0:01:41.672 **** 2020-02-12T14:09:18.663 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-02-12T14:09:18.664 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-02-12T14:09:18.701 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:18 +0000 (0:00:00.043) 0:01:41.716 **** 2020-02-12T14:09:18.706 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-02-12T14:09:18.708 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:18.747 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:18 +0000 (0:00:00.045) 0:01:41.762 **** 2020-02-12T14:09:18.754 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:18.790 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:18 +0000 (0:00:00.042) 0:01:41.805 **** 2020-02-12T14:09:18.794 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-02-12T14:09:18.833 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:18 +0000 (0:00:00.043) 0:01:41.848 **** 2020-02-12T14:09:18.875 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:18 +0000 (0:00:00.041) 0:01:41.890 **** 2020-02-12T14:09:18.882 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-02-12T14:09:18.883 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:18.917 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:18 +0000 (0:00:00.042) 0:01:41.933 **** 2020-02-12T14:09:18.923 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:18.959 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:18 +0000 (0:00:00.041) 0:01:41.974 **** 2020-02-12T14:09:18.963 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-02-12T14:09:18.965 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:19.000 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:18 +0000 (0:00:00.041) 0:01:42.015 **** 2020-02-12T14:09:19.006 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:19.043 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:19 +0000 (0:00:00.042) 0:01:42.058 **** 2020-02-12T14:09:19.047 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-02-12T14:09:19.049 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:19.085 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:19 +0000 (0:00:00.042) 0:01:42.100 **** 2020-02-12T14:09:19.090 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:19.126 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:19 +0000 (0:00:00.041) 0:01:42.142 **** 2020-02-12T14:09:19.131 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-02-12T14:09:19.133 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:19.167 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:19 +0000 (0:00:00.040) 0:01:42.182 **** 2020-02-12T14:09:19.174 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:19.208 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:19 +0000 (0:00:00.040) 0:01:42.223 **** 2020-02-12T14:09:19.213 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-02-12T14:09:19.215 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:19.249 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:19 +0000 (0:00:00.040) 0:01:42.264 **** 2020-02-12T14:09:19.254 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:19.291 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:19 +0000 (0:00:00.041) 0:01:42.306 **** 2020-02-12T14:09:19.295 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-02-12T14:09:19.297 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:19.331 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:19 +0000 (0:00:00.040) 0:01:42.346 **** 2020-02-12T14:09:19.336 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:19.372 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:19 +0000 (0:00:00.040) 0:01:42.387 **** 2020-02-12T14:09:19.377 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-02-12T14:09:19.379 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:19.413 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:19 +0000 (0:00:00.041) 0:01:42.428 **** 2020-02-12T14:09:19.419 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:19.455 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:19 +0000 (0:00:00.041) 0:01:42.470 **** 2020-02-12T14:09:19.460 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-02-12T14:09:19.461 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:19.497 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:19 +0000 (0:00:00.042) 0:01:42.512 **** 2020-02-12T14:09:19.503 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:19.540 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:19 +0000 (0:00:00.043) 0:01:42.556 **** 2020-02-12T14:09:19.545 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-02-12T14:09:19.547 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:19.582 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:19 +0000 (0:00:00.041) 0:01:42.597 **** 2020-02-12T14:09:19.588 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:19.624 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:19 +0000 (0:00:00.042) 0:01:42.639 **** 2020-02-12T14:09:19.629 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-02-12T14:09:19.630 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:19.665 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:19 +0000 (0:00:00.041) 0:01:42.680 **** 2020-02-12T14:09:19.671 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:19.712 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:19 +0000 (0:00:00.046) 0:01:42.727 **** 2020-02-12T14:09:19.717 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-02-12T14:09:19.718 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:19.756 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:19 +0000 (0:00:00.044) 0:01:42.772 **** 2020-02-12T14:09:19.762 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:19.800 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:19 +0000 (0:00:00.043) 0:01:42.815 **** 2020-02-12T14:09:19.807 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-02-12T14:09:19.808 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:19.844 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:19 +0000 (0:00:00.043) 0:01:42.859 **** 2020-02-12T14:09:19.849 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:19.886 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:19 +0000 (0:00:00.042) 0:01:42.901 **** 2020-02-12T14:09:19.890 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-02-12T14:09:19.891 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:19.929 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:19 +0000 (0:00:00.043) 0:01:42.944 **** 2020-02-12T14:09:19.935 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:19.973 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:19 +0000 (0:00:00.044) 0:01:42.989 **** 2020-02-12T14:09:19.978 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-02-12T14:09:19.979 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:20.015 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:20 +0000 (0:00:00.041) 0:01:43.030 **** 2020-02-12T14:09:20.023 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:20.058 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:20 +0000 (0:00:00.042) 0:01:43.073 **** 2020-02-12T14:09:20.063 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-02-12T14:09:20.064 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:20.101 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:20 +0000 (0:00:00.042) 0:01:43.116 **** 2020-02-12T14:09:20.106 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:20.145 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:20 +0000 (0:00:00.044) 0:01:43.160 **** 2020-02-12T14:09:20.151 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-02-12T14:09:20.151 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:20.191 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:20 +0000 (0:00:00.045) 0:01:43.206 **** 2020-02-12T14:09:20.197 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:20.233 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:20 +0000 (0:00:00.042) 0:01:43.248 **** 2020-02-12T14:09:20.240 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-02-12T14:09:20.241 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:20.276 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:20 +0000 (0:00:00.042) 0:01:43.291 **** 2020-02-12T14:09:20.281 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:20.319 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:20 +0000 (0:00:00.042) 0:01:43.334 **** 2020-02-12T14:09:20.324 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-02-12T14:09:20.325 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:20.364 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:20 +0000 (0:00:00.045) 0:01:43.379 **** 2020-02-12T14:09:20.369 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:20.405 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:20 +0000 (0:00:00.041) 0:01:43.421 **** 2020-02-12T14:09:20.411 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-02-12T14:09:20.411 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:20.448 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:20 +0000 (0:00:00.042) 0:01:43.463 **** 2020-02-12T14:09:20.456 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:20.492 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:20 +0000 (0:00:00.043) 0:01:43.507 **** 2020-02-12T14:09:20.496 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-02-12T14:09:20.497 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:20.532 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:20 +0000 (0:00:00.039) 0:01:43.547 **** 2020-02-12T14:09:20.537 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:20.574 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:20 +0000 (0:00:00.042) 0:01:43.589 **** 2020-02-12T14:09:20.578 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-02-12T14:09:20.579 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:20.614 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:20 +0000 (0:00:00.039) 0:01:43.629 **** 2020-02-12T14:09:20.619 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:20.655 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:20 +0000 (0:00:00.040) 0:01:43.670 **** 2020-02-12T14:09:20.660 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-02-12T14:09:20.660 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:20.695 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:20 +0000 (0:00:00.040) 0:01:43.710 **** 2020-02-12T14:09:20.700 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:20.736 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:20 +0000 (0:00:00.041) 0:01:43.752 **** 2020-02-12T14:09:20.748 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-02-12T14:09:20.749 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:20.785 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:20 +0000 (0:00:00.048) 0:01:43.800 **** 2020-02-12T14:09:20.791 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:20.828 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:20 +0000 (0:00:00.042) 0:01:43.842 **** 2020-02-12T14:09:20.832 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-02-12T14:09:20.832 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:20.869 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:20 +0000 (0:00:00.041) 0:01:43.884 **** 2020-02-12T14:09:20.875 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:20.911 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:20 +0000 (0:00:00.041) 0:01:43.926 **** 2020-02-12T14:09:20.916 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-02-12T14:09:20.917 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:20.953 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:20 +0000 (0:00:00.041) 0:01:43.968 **** 2020-02-12T14:09:20.966 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:21.000 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:20 +0000 (0:00:00.047) 0:01:44.016 **** 2020-02-12T14:09:21.005 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-02-12T14:09:21.005 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:21.041 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:21 +0000 (0:00:00.040) 0:01:44.056 **** 2020-02-12T14:09:21.046 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:21.083 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:21 +0000 (0:00:00.041) 0:01:44.098 **** 2020-02-12T14:09:21.255 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-02-12T14:09:21.255 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-02-12T14:09:21.290 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:21 +0000 (0:00:00.207) 0:01:44.305 **** 2020-02-12T14:09:21.297 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-02-12T14:09:21.333 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:21 +0000 (0:00:00.042) 0:01:44.348 **** 2020-02-12T14:09:21.495 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-02-12T14:09:21.495 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-02-12T14:09:21.532 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:21 +0000 (0:00:00.198) 0:01:44.547 **** 2020-02-12T14:09:21.548 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-02-12T14:09:21.583 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:21 +0000 (0:00:00.051) 0:01:44.598 **** 2020-02-12T14:09:21.736 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-02-12T14:09:21.738 INFO:teuthology.task.ansible.out: [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-02-12T14:09:21.771 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:21 +0000 (0:00:00.188) 0:01:44.786 **** 2020-02-12T14:09:21.799 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-02-12T14:09:21.800 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:21.834 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:21 +0000 (0:00:00.062) 0:01:44.849 **** 2020-02-12T14:09:21.865 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:21 +0000 (0:00:00.031) 0:01:44.880 **** 2020-02-12T14:09:21.870 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-02-12T14:09:21.871 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:21.906 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:21 +0000 (0:00:00.041) 0:01:44.922 **** 2020-02-12T14:09:21.912 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-02-12T14:09:21.913 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:21.948 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:21 +0000 (0:00:00.041) 0:01:44.963 **** 2020-02-12T14:09:21.953 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-02-12T14:09:21.953 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:21.993 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:21 +0000 (0:00:00.044) 0:01:45.008 **** 2020-02-12T14:09:21.999 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-02-12T14:09:22.001 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:22.042 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:22 +0000 (0:00:00.048) 0:01:45.057 **** 2020-02-12T14:09:22.049 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-02-12T14:09:22.051 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:22.088 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:22 +0000 (0:00:00.046) 0:01:45.103 **** 2020-02-12T14:09:22.094 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-02-12T14:09:22.095 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:22.134 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:22 +0000 (0:00:00.045) 0:01:45.149 **** 2020-02-12T14:09:22.140 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-02-12T14:09:22.142 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:22.180 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:22 +0000 (0:00:00.045) 0:01:45.195 **** 2020-02-12T14:09:22.185 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-02-12T14:09:22.186 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:22.225 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:22 +0000 (0:00:00.044) 0:01:45.240 **** 2020-02-12T14:09:22.230 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-02-12T14:09:22.230 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:22.269 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:22 +0000 (0:00:00.044) 0:01:45.284 **** 2020-02-12T14:09:22.276 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-02-12T14:09:22.278 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:22.315 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:22 +0000 (0:00:00.045) 0:01:45.330 **** 2020-02-12T14:09:22.320 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-02-12T14:09:22.321 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:22.359 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:22 +0000 (0:00:00.043) 0:01:45.374 **** 2020-02-12T14:09:22.365 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-02-12T14:09:22.365 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:22.404 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:22 +0000 (0:00:00.044) 0:01:45.419 **** 2020-02-12T14:09:22.409 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-02-12T14:09:22.410 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:22.449 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:22 +0000 (0:00:00.045) 0:01:45.464 **** 2020-02-12T14:09:22.455 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-02-12T14:09:22.455 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:22.495 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:22 +0000 (0:00:00.045) 0:01:45.510 **** 2020-02-12T14:09:22.500 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-02-12T14:09:22.501 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:22.537 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:22 +0000 (0:00:00.042) 0:01:45.553 **** 2020-02-12T14:09:22.542 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-02-12T14:09:22.543 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:22.581 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:22 +0000 (0:00:00.043) 0:01:45.596 **** 2020-02-12T14:09:22.589 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:22.624 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:22 +0000 (0:00:00.043) 0:01:45.639 **** 2020-02-12T14:09:22.630 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-02-12T14:09:22.632 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:22.669 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:22 +0000 (0:00:00.045) 0:01:45.684 **** 2020-02-12T14:09:22.674 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-02-12T14:09:22.675 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:22.719 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:22 +0000 (0:00:00.049) 0:01:45.734 **** 2020-02-12T14:09:22.723 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-02-12T14:09:22.724 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:22.759 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:22 +0000 (0:00:00.040) 0:01:45.774 **** 2020-02-12T14:09:22.763 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-02-12T14:09:22.764 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:22.798 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:22 +0000 (0:00:00.039) 0:01:45.814 **** 2020-02-12T14:09:22.803 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-02-12T14:09:22.805 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:22.837 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:22 +0000 (0:00:00.039) 0:01:45.853 **** 2020-02-12T14:09:22.842 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-02-12T14:09:22.844 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:22.877 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:22 +0000 (0:00:00.039) 0:01:45.892 **** 2020-02-12T14:09:22.882 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-02-12T14:09:22.884 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:22.918 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:22 +0000 (0:00:00.040) 0:01:45.933 **** 2020-02-12T14:09:22.921 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-02-12T14:09:22.922 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:22.956 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:22 +0000 (0:00:00.038) 0:01:45.971 **** 2020-02-12T14:09:22.963 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-02-12T14:09:22.965 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:22.999 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:22 +0000 (0:00:00.043) 0:01:46.014 **** 2020-02-12T14:09:23.004 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-02-12T14:09:23.006 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.041 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:23 +0000 (0:00:00.041) 0:01:46.056 **** 2020-02-12T14:09:23.046 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-02-12T14:09:23.047 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.083 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:23 +0000 (0:00:00.042) 0:01:46.098 **** 2020-02-12T14:09:23.088 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-02-12T14:09:23.088 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.125 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:23 +0000 (0:00:00.041) 0:01:46.140 **** 2020-02-12T14:09:23.130 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-02-12T14:09:23.131 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.166 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:23 +0000 (0:00:00.041) 0:01:46.181 **** 2020-02-12T14:09:23.171 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-02-12T14:09:23.171 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.209 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:23 +0000 (0:00:00.043) 0:01:46.224 **** 2020-02-12T14:09:23.215 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-02-12T14:09:23.215 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.250 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:23 +0000 (0:00:00.041) 0:01:46.265 **** 2020-02-12T14:09:23.257 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-02-12T14:09:23.258 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.292 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:23 +0000 (0:00:00.042) 0:01:46.308 **** 2020-02-12T14:09:23.298 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-02-12T14:09:23.299 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.333 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:23 +0000 (0:00:00.041) 0:01:46.349 **** 2020-02-12T14:09:23.338 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-02-12T14:09:23.338 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.374 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:23 +0000 (0:00:00.041) 0:01:46.390 **** 2020-02-12T14:09:23.380 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-02-12T14:09:23.380 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.416 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:23 +0000 (0:00:00.041) 0:01:46.431 **** 2020-02-12T14:09:23.420 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-02-12T14:09:23.421 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.461 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:23 +0000 (0:00:00.045) 0:01:46.476 **** 2020-02-12T14:09:23.468 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-02-12T14:09:23.469 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.509 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:23 +0000 (0:00:00.047) 0:01:46.524 **** 2020-02-12T14:09:23.514 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-02-12T14:09:23.515 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.554 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:23 +0000 (0:00:00.045) 0:01:46.569 **** 2020-02-12T14:09:23.559 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-02-12T14:09:23.561 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.598 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:23 +0000 (0:00:00.044) 0:01:46.614 **** 2020-02-12T14:09:23.604 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-02-12T14:09:23.606 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.643 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:23 +0000 (0:00:00.044) 0:01:46.658 **** 2020-02-12T14:09:23.648 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-02-12T14:09:23.650 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.686 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:23 +0000 (0:00:00.043) 0:01:46.701 **** 2020-02-12T14:09:23.694 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-12T14:09:23.695 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-02-12T14:09:23.730 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:23 +0000 (0:00:00.043) 0:01:46.746 **** 2020-02-12T14:09:23.737 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-02-12T14:09:23.738 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.781 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:23 +0000 (0:00:00.050) 0:01:46.796 **** 2020-02-12T14:09:23.786 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-02-12T14:09:23.792 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} ok: [smithi072.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-02-12T14:09:23.799 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.799 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.810 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-12T14:09:23.812 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi072.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.848 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:23 +0000 (0:00:00.066) 0:01:46.863 **** 2020-02-12T14:09:23.853 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.854 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.895 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:23 +0000 (0:00:00.047) 0:01:46.910 **** 2020-02-12T14:09:23.901 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.902 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-02-12T14:09:23.913 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.914 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.925 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.935 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.946 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-02-12T14:09:23.986 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:23 +0000 (0:00:00.090) 0:01:47.001 **** 2020-02-12T14:09:24.032 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-02-12T14:09:24.038 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003373", "end": "2020-02-12 14:09:24.011959", "rc": 0, "start": "2020-02-12 14:09:24.008586", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-02-12T14:09:24.082 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:24 +0000 (0:00:00.095) 0:01:47.097 **** 2020-02-12T14:09:24.120 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-02-12T14:09:24.121 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:24.158 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:24 +0000 (0:00:00.076) 0:01:47.173 **** 2020-02-12T14:09:24.164 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-02-12T14:09:24.164 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003563", "end": "2020-02-12 14:09:24.112384", "rc": 0, "start": "2020-02-12 14:09:24.108821", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-02-12T14:09:24.206 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:24 +0000 (0:00:00.047) 0:01:47.221 **** 2020-02-12T14:09:24.211 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-02-12T14:09:24.212 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:24.249 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:24 +0000 (0:00:00.043) 0:01:47.265 **** 2020-02-12T14:09:24.255 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-02-12T14:09:24.255 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:24.296 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:24 +0000 (0:00:00.046) 0:01:47.311 **** 2020-02-12T14:09:24.302 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-02-12T14:09:24.303 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:24.339 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:24 +0000 (0:00:00.043) 0:01:47.355 **** 2020-02-12T14:09:24.344 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-02-12T14:09:24.346 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:24.382 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:24 +0000 (0:00:00.042) 0:01:47.397 **** 2020-02-12T14:09:24.386 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-02-12T14:09:24.386 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:24.423 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:24 +0000 (0:00:00.041) 0:01:47.438 **** 2020-02-12T14:09:24.428 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-02-12T14:09:24.429 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:24.467 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:24 +0000 (0:00:00.043) 0:01:47.482 **** 2020-02-12T14:09:24.492 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-02-12T14:09:24.493 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:24.528 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:24 +0000 (0:00:00.060) 0:01:47.543 **** 2020-02-12T14:09:25.334 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-02-12T14:09:25.335 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-02-12T14:09:25.371 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:25 +0000 (0:00:00.843) 0:01:48.386 **** 2020-02-12T14:09:25.408 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-02-12T14:09:25.408 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => (item={u'block_used': 12962480, u'uuid': u'66e056a8-b246-4f81-96dd-96b23573000c', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227132628, u'size_available': 930335244288, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989886, u'device': u'/dev/sda1', u'inode_used': 65090, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227132628, "block_size": 4096, "block_total": 240095108, "block_used": 12962480, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989886, "inode_total": 61054976, "inode_used": 65090, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930335244288, "size_total": 983429562368, "uuid": "66e056a8-b246-4f81-96dd-96b23573000c"}} 2020-02-12T14:09:25.446 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:25 +0000 (0:00:00.075) 0:01:48.461 **** 2020-02-12T14:09:25.452 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-02-12T14:09:25.452 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-02-12T14:09:25.492 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:25 +0000 (0:00:00.045) 0:01:48.507 **** 2020-02-12T14:09:25.528 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-02-12T14:09:25.529 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={u'block_used': 12962440, u'uuid': u'66e056a8-b246-4f81-96dd-96b23573000c', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227132668, u'size_available': 930335408128, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989889, u'device': u'/dev/sda1', u'inode_used': 65087, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227132668, "block_size": 4096, "block_total": 240095108, "block_used": 12962440, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989889, "inode_total": 61054976, "inode_used": 65087, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930335408128, "size_total": 983429562368, "uuid": "66e056a8-b246-4f81-96dd-96b23573000c"}} 2020-02-12T14:09:25.566 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:25 +0000 (0:00:00.074) 0:01:48.581 **** 2020-02-12T14:09:25.643 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-02-12T14:09:25.645 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.004998", "end": "2020-02-12 14:09:25.623891", "rc": 0, "start": "2020-02-12 14:09:25.618893", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T14:09:25.681 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:25 +0000 (0:00:00.114) 0:01:48.696 **** 2020-02-12T14:09:25.719 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-02-12T14:09:25.720 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'block_used': 12962480, u'uuid': u'66e056a8-b246-4f81-96dd-96b23573000c', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227132628, u'size_available': 930335244288, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989886, u'device': u'/dev/sda1', u'inode_used': 65090, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227132628, "block_size": 4096, "block_total": 240095108, "block_used": 12962480, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989886, "inode_total": 61054976, "inode_used": 65090, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930335244288, "size_total": 983429562368, "uuid": "66e056a8-b246-4f81-96dd-96b23573000c"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:25.756 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:25 +0000 (0:00:00.075) 0:01:48.771 **** 2020-02-12T14:09:25.760 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-02-12T14:09:25.761 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005067", "end": "2020-02-12 14:09:25.739994", "rc": 0, "start": "2020-02-12 14:09:25.734927", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T14:09:25.799 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:25 +0000 (0:00:00.042) 0:01:48.814 **** 2020-02-12T14:09:25.803 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-02-12T14:09:25.845 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:25 +0000 (0:00:00.045) 0:01:48.860 **** 2020-02-12T14:09:25.850 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-02-12T14:09:25.850 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'block_used': 12962440, u'uuid': u'66e056a8-b246-4f81-96dd-96b23573000c', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227132668, u'size_available': 930335408128, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989889, u'device': u'/dev/sda1', u'inode_used': 65087, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227132668, "block_size": 4096, "block_total": 240095108, "block_used": 12962440, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989889, "inode_total": 61054976, "inode_used": 65087, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930335408128, "size_total": 983429562368, "uuid": "66e056a8-b246-4f81-96dd-96b23573000c"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:25.891 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:25 +0000 (0:00:00.046) 0:01:48.906 **** 2020-02-12T14:09:25.897 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-02-12T14:09:25.898 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QEKN', u'wwn-0x5000c50091e0531c'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QEKN', u'wwn': u'0x5000c50091e0531c', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'66e056a8-b246-4f81-96dd-96b23573000c', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QEKN-part1', u'wwn-0x5000c50091e0531c-part1'], u'uuids': [u'66e056a8-b246-4f81-96dd-96b23573000c']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QEKN", "wwn-0x5000c50091e0531c"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QEKN-part1", "wwn-0x5000c50091e0531c-part1"], "labels": [], "masters": [], "uuids": ["66e056a8-b246-4f81-96dd-96b23573000c"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "66e056a8-b246-4f81-96dd-96b23573000c"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QEKN", "size": "931.51 GB", "support_discard": "0", "vend 2020-02-12T14:09:25.900 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c50091e0531c"}}, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:25.910 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-02-12T14:09:25.952 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:25 +0000 (0:00:00.060) 0:01:48.967 **** 2020-02-12T14:09:25.987 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-02-12T14:09:25.988 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFR4', u'wwn-0x5000c500929226ed'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XFR4', u'wwn': u'0x5000c500929226ed', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'66e056a8-b246-4f81-96dd-96b23573000c', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFR4-part1', u'wwn-0x5000c500929226ed-part1'], u'uuids': [u'66e056a8-b246-4f81-96dd-96b23573000c']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFR4", "wwn-0x5000c500929226ed"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFR4-part1", "wwn-0x5000c500929226ed-part1"], "labels": [], "masters": [], "uuids": ["66e056a8-b246-4f81-96dd-96b23573000c"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "66e056a8-b246-4f81-96dd-96b23573000c"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFR4", "size": "931.51 GB", "support_discard": "0", "vend 2020-02-12T14:09:25.990 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c500929226ed"}}, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:27.570 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-scWmOS-I04R-5C3g-dooD-CcZS-8QCk-zd41nh', u'nvme-INTEL_SSDPEDMD400G4_PHFT620500N6400BGN', u'nvme-nvme.8086-504846543632303530304e3634303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.377157", "end": "2020-02-12 14:09:27.529448", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-scWmOS-I04R-5C3g-dooD-CcZS-8QCk-zd41nh", "nvme-INTEL_SSDPEDMD400G4_PHFT620500N6400BGN", "nvme-nvme.8086-504846543632303530304e3634303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 14:09:26.152291", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-02-12T14:09:27.571 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-12T14:09:27.573 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-xB2p1Z-aHia-TTYz-fy6V-BLFM-MoiZ-8pgMSP', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400V7400BGN', u'nvme-nvme.8086-50484654363230343030563734303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.498584", "end": "2020-02-12 14:09:27.539405", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-xB2p1Z-aHia-TTYz-fy6V-BLFM-MoiZ-8pgMSP", "nvme-INTEL_SSDPEDMD400G4_PHFT620400V7400BGN", "nvme-nvme.8086-50484654363230343030563734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 14:09:26.040821", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-02-12T14:09:27.574 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-12T14:09:28.798 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-0Ikbk4TquLutnp8DfR3eAbq5fN880H5Yf1v0Nr4L0cvCDVg606gs04pUZ30Pvc2A'], u'uuids': [u'55842f41-ce0c-4080-b953-a3a2a590016f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.036820", "end": "2020-02-12 14:09:28.764224", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-0Ikbk4TquLutnp8DfR3eAbq5fN880H5Yf1v0Nr4L0cvCDVg606gs04pUZ30Pvc2A"], "labels": [], "masters": [], "uuids": ["55842f41-ce0c-4080-b953-a3a2a590016f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 14:09:27.727404", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-12T14:09:28.821 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-8Og0GEs6to5Nf6oZUVrJMh3cfMeDAcWR36HjYJ3vkOCOaWz6LV3dD2rsgTwD2JnH'], u'uuids': [u'455e52c6-56ad-427a-ae56-a7adf7ab8dbe']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.052873", "end": "2020-02-12 14:09:28.787189", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-8Og0GEs6to5Nf6oZUVrJMh3cfMeDAcWR36HjYJ3vkOCOaWz6LV3dD2rsgTwD2JnH"], "labels": [], "masters": [], "uuids": ["455e52c6-56ad-427a-ae56-a7adf7ab8dbe"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 14:09:27.734316", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-12T14:09:30.056 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-8Og0GEs6to5Nf6oZUVrJMh3cfMeDAcWRBB3hfT10p1qTv4CxK3h0uAeqbkftaWM1'], u'uuids': [u'906fc5d6-a30f-4f14-8d16-b42ed678ba32']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.044151", "end": "2020-02-12 14:09:30.028491", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-8Og0GEs6to5Nf6oZUVrJMh3cfMeDAcWRBB3hfT10p1qTv4CxK3h0uAeqbkftaWM1"], "labels": [], "masters": [], "uuids": ["906fc5d6-a30f-4f14-8d16-b42ed678ba32"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 14:09:28.984340", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-12T14:09:30.089 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-0Ikbk4TquLutnp8DfR3eAbq5fN880H5YWp6ahGmgpiRmtrnMCT25bJtkwtP6ndqK'], u'uuids': [u'cf173d13-c25a-42e7-b26a-dffc7f8e5416']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.069927", "end": "2020-02-12 14:09:30.055347", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-0Ikbk4TquLutnp8DfR3eAbq5fN880H5YWp6ahGmgpiRmtrnMCT25bJtkwtP6ndqK"], "labels": [], "masters": [], "uuids": ["cf173d13-c25a-42e7-b26a-dffc7f8e5416"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 14:09:28.985420", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-12T14:09:31.308 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-8Og0GEs6to5Nf6oZUVrJMh3cfMeDAcWRMbs7pycI3SxJdmxXwueLst0qJNAPf257'], u'uuids': [u'2d2668bb-ad11-4e54-a6cb-817a36869eed']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.053222", "end": "2020-02-12 14:09:31.270570", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-8Og0GEs6to5Nf6oZUVrJMh3cfMeDAcWRMbs7pycI3SxJdmxXwueLst0qJNAPf257"], "labels": [], "masters": [], "uuids": ["2d2668bb-ad11-4e54-a6cb-817a36869eed"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 14:09:30.217348", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-12T14:09:31.320 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-0Ikbk4TquLutnp8DfR3eAbq5fN880H5YZj6WJnsELcSWcDd6Jg9u5rtG7krpKKLt'], u'uuids': [u'47e3cf9d-9c6c-46ab-85fb-922bf303078e']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.045566", "end": "2020-02-12 14:09:31.289972", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-0Ikbk4TquLutnp8DfR3eAbq5fN880H5YZj6WJnsELcSWcDd6Jg9u5rtG7krpKKLt"], "labels": [], "masters": [], "uuids": ["47e3cf9d-9c6c-46ab-85fb-922bf303078e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 14:09:30.244406", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-12T14:09:32.543 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-8Og0GEs6to5Nf6oZUVrJMh3cfMeDAcWRcN7iOWONTtGRYHL6eu33Nz2YA0lZK8uf'], u'uuids': [u'0111fa77-96e9-4e79-93b3-a654e00af2a2']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.047273", "end": "2020-02-12 14:09:32.512312", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-8Og0GEs6to5Nf6oZUVrJMh3cfMeDAcWRcN7iOWONTtGRYHL6eu33Nz2YA0lZK8uf"], "labels": [], "masters": [], "uuids": ["0111fa77-96e9-4e79-93b3-a654e00af2a2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 14:09:31.465039", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-12T14:09:32.555 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-0Ikbk4TquLutnp8DfR3eAbq5fN880H5Y4eMlFiHFPFy5dRA5lfNSdhVQXzk11L7A'], u'uuids': [u'80faf5d0-eb3c-45f1-8c30-3a0754862f86']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.046477", "end": "2020-02-12 14:09:32.524470", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-0Ikbk4TquLutnp8DfR3eAbq5fN880H5Y4eMlFiHFPFy5dRA5lfNSdhVQXzk11L7A"], "labels": [], "masters": [], "uuids": ["80faf5d0-eb3c-45f1-8c30-3a0754862f86"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 14:09:31.477993", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-12T14:09:33.780 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-8Og0GEs6to5Nf6oZUVrJMh3cfMeDAcWRsVHHYMKudGwpLxXyyM81Xxr121sgvuot'], u'uuids': [u'bfc61582-2de3-4b41-a1c0-64506ff95858']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.045283", "end": "2020-02-12 14:09:33.754230", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-8Og0GEs6to5Nf6oZUVrJMh3cfMeDAcWRsVHHYMKudGwpLxXyyM81Xxr121sgvuot"], "labels": [], "masters": [], "uuids": ["bfc61582-2de3-4b41-a1c0-64506ff95858"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 14:09:32.708947", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-12T14:09:33.805 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-0Ikbk4TquLutnp8DfR3eAbq5fN880H5YLNYDyCPRnRN8mL1ng7RCXN7V2RW3wmaN'], u'uuids': [u'f8a9ed2d-ea6f-4819-8110-1d2de6ccb07d']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.045136", "end": "2020-02-12 14:09:33.765955", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-0Ikbk4TquLutnp8DfR3eAbq5fN880H5YLNYDyCPRnRN8mL1ng7RCXN7V2RW3wmaN"], "labels": [], "masters": [], "uuids": ["f8a9ed2d-ea6f-4819-8110-1d2de6ccb07d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 14:09:32.720819", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-12T14:09:33.851 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:33 +0000 (0:00:07.896) 0:01:56.863 **** 2020-02-12T14:09:33.886 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:33 +0000 (0:00:00.035) 0:01:56.901 **** 2020-02-12T14:09:33.892 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-02-12T14:09:33.895 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QEKN', u'wwn-0x5000c50091e0531c'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QEKN', u'wwn': u'0x5000c50091e0531c', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'66e056a8-b246-4f81-96dd-96b23573000c', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QEKN-part1', u'wwn-0x5000c50091e0531c-part1'], u'uuids': [u'66e056a8-b246-4f81-96dd-96b23573000c']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QEKN", "wwn-0x5000c50091e0531c"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QEKN-part1", "wwn-0x5000c50091e0531c-part1"], "labels": [], "masters": [], "uuids": ["66e056a8-b246-4f81-96dd-96b23573000c"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "66e056a8-b246-4f81-96dd-96b23573000c"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QEKN", "size": "931.51 GB", "support_discard": "0", "vend 2020-02-12T14:09:33.896 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c50091e0531c"}}, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:33.930 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFR4', u'wwn-0x5000c500929226ed'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XFR4', u'wwn': u'0x5000c500929226ed', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'66e056a8-b246-4f81-96dd-96b23573000c', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFR4-part1', u'wwn-0x5000c500929226ed-part1'], u'uuids': [u'66e056a8-b246-4f81-96dd-96b23573000c']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFR4", "wwn-0x5000c500929226ed"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFR4-part1", "wwn-0x5000c500929226ed-part1"], "labels": [], "masters": [], "uuids": ["66e056a8-b246-4f81-96dd-96b23573000c"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "66e056a8-b246-4f81-96dd-96b23573000c"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFR4", "size": "931.51 GB", "support_discard": "0", "vend 2020-02-12T14:09:33.931 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c500929226ed"}}, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:34.122 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-xB2p1Z-aHia-TTYz-fy6V-BLFM-MoiZ-8pgMSP', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400V7400BGN', u'nvme-nvme.8086-50484654363230343030563734303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037322", "end": "2020-02-12 14:09:34.092511", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-xB2p1Z-aHia-TTYz-fy6V-BLFM-MoiZ-8pgMSP", "nvme-INTEL_SSDPEDMD400G4_PHFT620400V7400BGN", "nvme-nvme.8086-50484654363230343030563734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 14:09:34.055189", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-02-12T14:09:34.125 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0346303 s, 3.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0346303 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-02-12T14:09:34.156 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-scWmOS-I04R-5C3g-dooD-CcZS-8QCk-zd41nh', u'nvme-INTEL_SSDPEDMD400G4_PHFT620500N6400BGN', u'nvme-nvme.8086-504846543632303530304e3634303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037728", "end": "2020-02-12 14:09:34.130698", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-scWmOS-I04R-5C3g-dooD-CcZS-8QCk-zd41nh", "nvme-INTEL_SSDPEDMD400G4_PHFT620500N6400BGN", "nvme-nvme.8086-504846543632303530304e3634303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 14:09:34.092970", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-02-12T14:09:34.157 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.035017 s, 3.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.035017 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-02-12T14:09:34.454 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-8Og0GEs6to5Nf6oZUVrJMh3cfMeDAcWR36HjYJ3vkOCOaWz6LV3dD2rsgTwD2JnH'], u'uuids': [u'455e52c6-56ad-427a-ae56-a7adf7ab8dbe']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.140883", "end": "2020-02-12 14:09:34.427614", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-8Og0GEs6to5Nf6oZUVrJMh3cfMeDAcWR36HjYJ3vkOCOaWz6LV3dD2rsgTwD2JnH"], "labels": [], "masters": [], "uuids": ["455e52c6-56ad-427a-ae56-a7adf7ab8dbe"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 14:09:34.286731", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138286 s, 834 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138286 s, 834 MB/s"], "stdout": "", "stdout_lines": []} 2020-02-12T14:09:34.512 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-0Ikbk4TquLutnp8DfR3eAbq5fN880H5Yf1v0Nr4L0cvCDVg606gs04pUZ30Pvc2A'], u'uuids': [u'55842f41-ce0c-4080-b953-a3a2a590016f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.152205", "end": "2020-02-12 14:09:34.478836", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-0Ikbk4TquLutnp8DfR3eAbq5fN880H5Yf1v0Nr4L0cvCDVg606gs04pUZ30Pvc2A"], "labels": [], "masters": [], "uuids": ["55842f41-ce0c-4080-b953-a3a2a590016f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 14:09:34.326631", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.149582 s, 771 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.149582 s, 771 MB/s"], "stdout": "", "stdout_lines": []} 2020-02-12T14:09:34.785 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-8Og0GEs6to5Nf6oZUVrJMh3cfMeDAcWRBB3hfT10p1qTv4CxK3h0uAeqbkftaWM1'], u'uuids': [u'906fc5d6-a30f-4f14-8d16-b42ed678ba32']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.143093", "end": "2020-02-12 14:09:34.751952", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-8Og0GEs6to5Nf6oZUVrJMh3cfMeDAcWRBB3hfT10p1qTv4CxK3h0uAeqbkftaWM1"], "labels": [], "masters": [], "uuids": ["906fc5d6-a30f-4f14-8d16-b42ed678ba32"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 14:09:34.608859", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.140511 s, 821 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.140511 s, 821 MB/s"], "stdout": "", "stdout_lines": []} 2020-02-12T14:09:34.838 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-0Ikbk4TquLutnp8DfR3eAbq5fN880H5YWp6ahGmgpiRmtrnMCT25bJtkwtP6ndqK'], u'uuids': [u'cf173d13-c25a-42e7-b26a-dffc7f8e5416']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.142035", "end": "2020-02-12 14:09:34.807895", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-0Ikbk4TquLutnp8DfR3eAbq5fN880H5YWp6ahGmgpiRmtrnMCT25bJtkwtP6ndqK"], "labels": [], "masters": [], "uuids": ["cf173d13-c25a-42e7-b26a-dffc7f8e5416"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 14:09:34.665860", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139483 s, 827 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139483 s, 827 MB/s"], "stdout": "", "stdout_lines": []} 2020-02-12T14:09:35.111 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-8Og0GEs6to5Nf6oZUVrJMh3cfMeDAcWRMbs7pycI3SxJdmxXwueLst0qJNAPf257'], u'uuids': [u'2d2668bb-ad11-4e54-a6cb-817a36869eed']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.150081", "end": "2020-02-12 14:09:35.086208", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-8Og0GEs6to5Nf6oZUVrJMh3cfMeDAcWRMbs7pycI3SxJdmxXwueLst0qJNAPf257"], "labels": [], "masters": [], "uuids": ["2d2668bb-ad11-4e54-a6cb-817a36869eed"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 14:09:34.936127", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.14763 s, 781 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.14763 s, 781 MB/s"], "stdout": "", "stdout_lines": []} 2020-02-12T14:09:35.113 INFO:teuthology.task.ansible.out: 2020-02-12T14:09:35.155 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-0Ikbk4TquLutnp8DfR3eAbq5fN880H5YZj6WJnsELcSWcDd6Jg9u5rtG7krpKKLt'], u'uuids': [u'47e3cf9d-9c6c-46ab-85fb-922bf303078e']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.140974", "end": "2020-02-12 14:09:35.129643", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-0Ikbk4TquLutnp8DfR3eAbq5fN880H5YZj6WJnsELcSWcDd6Jg9u5rtG7krpKKLt"], "labels": [], "masters": [], "uuids": ["47e3cf9d-9c6c-46ab-85fb-922bf303078e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 14:09:34.988669", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138506 s, 833 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138506 s, 833 MB/s"], "stdout": "", "stdout_lines": []} 2020-02-12T14:09:35.444 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-8Og0GEs6to5Nf6oZUVrJMh3cfMeDAcWRcN7iOWONTtGRYHL6eu33Nz2YA0lZK8uf'], u'uuids': [u'0111fa77-96e9-4e79-93b3-a654e00af2a2']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.141070", "end": "2020-02-12 14:09:35.413129", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-8Og0GEs6to5Nf6oZUVrJMh3cfMeDAcWRcN7iOWONTtGRYHL6eu33Nz2YA0lZK8uf"], "labels": [], "masters": [], "uuids": ["0111fa77-96e9-4e79-93b3-a654e00af2a2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 14:09:35.272059", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138641 s, 832 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138641 s, 832 MB/s"], "stdout": "", "stdout_lines": []} 2020-02-12T14:09:35.477 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-0Ikbk4TquLutnp8DfR3eAbq5fN880H5Y4eMlFiHFPFy5dRA5lfNSdhVQXzk11L7A'], u'uuids': [u'80faf5d0-eb3c-45f1-8c30-3a0754862f86']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.142174", "end": "2020-02-12 14:09:35.454568", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-0Ikbk4TquLutnp8DfR3eAbq5fN880H5Y4eMlFiHFPFy5dRA5lfNSdhVQXzk11L7A"], "labels": [], "masters": [], "uuids": ["80faf5d0-eb3c-45f1-8c30-3a0754862f86"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 14:09:35.312394", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139599 s, 826 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139599 s, 826 MB/s"], "stdout": "", "stdout_lines": []} 2020-02-12T14:09:35.773 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-8Og0GEs6to5Nf6oZUVrJMh3cfMeDAcWRsVHHYMKudGwpLxXyyM81Xxr121sgvuot'], u'uuids': [u'bfc61582-2de3-4b41-a1c0-64506ff95858']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.140866", "end": "2020-02-12 14:09:35.743754", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-8Og0GEs6to5Nf6oZUVrJMh3cfMeDAcWRsVHHYMKudGwpLxXyyM81Xxr121sgvuot"], "labels": [], "masters": [], "uuids": ["bfc61582-2de3-4b41-a1c0-64506ff95858"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 14:09:35.602888", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138316 s, 834 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138316 s, 834 MB/s"], "stdout": "", "stdout_lines": []} 2020-02-12T14:09:35.822 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:35 +0000 (0:00:01.935) 0:01:58.837 **** 2020-02-12T14:09:35.823 INFO:teuthology.task.ansible.out: 2020-02-12T14:09:35.830 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-0Ikbk4TquLutnp8DfR3eAbq5fN880H5YLNYDyCPRnRN8mL1ng7RCXN7V2RW3wmaN'], u'uuids': [u'f8a9ed2d-ea6f-4819-8110-1d2de6ccb07d']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.139480", "end": "2020-02-12 14:09:35.775198", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-0Ikbk4TquLutnp8DfR3eAbq5fN880H5YLNYDyCPRnRN8mL1ng7RCXN7V2RW3wmaN"], "labels": [], "masters": [], "uuids": ["f8a9ed2d-ea6f-4819-8110-1d2de 2020-02-12T14:09:35.832 INFO:teuthology.task.ansible.out:6ccb07d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 14:09:35.635718", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136922 s, 842 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136922 s, 842 MB/s"], "stdout": "", "stdout_lines": []} 2020-02-12T14:09:35.884 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:35 +0000 (0:00:00.062) 0:01:58.899 **** 2020-02-12T14:09:35.886 INFO:teuthology.task.ansible.out: 2020-02-12T14:09:36.097 INFO:teuthology.task.ansible.out: 2020-02-12T14:09:36.098 INFO:teuthology.task.ansible.out:TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi072.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.073127", "end": "2020-02-12 14:09:36.065177", "rc": 0, "start": "2020-02-12 14:09:35.992050", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T14:09:36.137 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:36 +0000 (0:00:00.252) 0:01:59.152 **** 2020-02-12T14:09:36.138 INFO:teuthology.task.ansible.out: 2020-02-12T14:09:36.165 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.075069", "end": "2020-02-12 14:09:36.132574", "rc": 0, "start": "2020-02-12 14:09:36.057505", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T14:09:36.166 INFO:teuthology.task.ansible.out: 2020-02-12T14:09:36.203 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:36 +0000 (0:00:00.066) 0:01:59.218 **** 2020-02-12T14:09:36.205 INFO:teuthology.task.ansible.out: 2020-02-12T14:09:36.378 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-02-12T14:09:36.380 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.051612", "end": "2020-02-12 14:09:36.358745", "rc": 0, "start": "2020-02-12 14:09:36.307133", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T14:09:36.415 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:36 +0000 (0:00:00.211) 0:01:59.430 **** 2020-02-12T14:09:36.440 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-02-12T14:09:36.441 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-02-12T14:09:36.443 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.049539", "end": "2020-02-12 14:09:36.421002", "rc": 0, "start": "2020-02-12 14:09:36.371463", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T14:09:36.501 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:36 +0000 (0:00:00.086) 0:01:59.516 **** 2020-02-12T14:09:36.552 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:36 +0000 (0:00:00.050) 0:01:59.566 **** 2020-02-12T14:09:36.556 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-02-12T14:09:36.557 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:36.598 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:36 +0000 (0:00:00.046) 0:01:59.613 **** 2020-02-12T14:09:36.603 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-02-12T14:09:36.644 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:36 +0000 (0:00:00.046) 0:01:59.659 **** 2020-02-12T14:09:36.650 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-02-12T14:09:36.651 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:36.688 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:36 +0000 (0:00:00.044) 0:01:59.704 **** 2020-02-12T14:09:36.694 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-02-12T14:09:36.695 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:36.736 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:36 +0000 (0:00:00.047) 0:01:59.751 **** 2020-02-12T14:09:36.741 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-02-12T14:09:36.743 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:36.784 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:36 +0000 (0:00:00.047) 0:01:59.799 **** 2020-02-12T14:09:36.790 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-02-12T14:09:36.792 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:36.829 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:36 +0000 (0:00:00.044) 0:01:59.844 **** 2020-02-12T14:09:36.834 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-02-12T14:09:36.835 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:36.874 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:36 +0000 (0:00:00.044) 0:01:59.889 **** 2020-02-12T14:09:36.884 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-02-12T14:09:36.885 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:36.938 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:36 +0000 (0:00:00.064) 0:01:59.953 **** 2020-02-12T14:09:36.965 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-02-12T14:09:36.966 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:37.002 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:36 +0000 (0:00:00.064) 0:02:00.018 **** 2020-02-12T14:09:37.072 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi072.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-12T14:09:37.111 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:37 +0000 (0:00:00.108) 0:02:00.126 **** 2020-02-12T14:09:37.149 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-02-12T14:09:37.149 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={u'block_used': 12962480, u'uuid': u'66e056a8-b246-4f81-96dd-96b23573000c', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227132628, u'size_available': 930335244288, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989886, u'device': u'/dev/sda1', u'inode_used': 65090, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227132628, "block_size": 4096, "block_total": 240095108, "block_used": 12962480, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989886, "inode_total": 61054976, "inode_used": 65090, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930335244288, "size_total": 983429562368, "uuid": "66e056a8-b246-4f81-96dd-96b23573000c"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:37.195 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:37 +0000 (0:00:00.084) 0:02:00.211 **** 2020-02-12T14:09:37.201 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-02-12T14:09:37.201 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-12T14:09:37.240 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:37 +0000 (0:00:00.044) 0:02:00.255 **** 2020-02-12T14:09:37.245 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-02-12T14:09:37.247 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:37.285 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:37 +0000 (0:00:00.044) 0:02:00.300 **** 2020-02-12T14:09:37.301 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-02-12T14:09:37.302 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={u'block_used': 12962440, u'uuid': u'66e056a8-b246-4f81-96dd-96b23573000c', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227132668, u'size_available': 930335408128, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989889, u'device': u'/dev/sda1', u'inode_used': 65087, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227132668, "block_size": 4096, "block_total": 240095108, "block_used": 12962440, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989889, "inode_total": 61054976, "inode_used": 65087, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930335408128, "size_total": 983429562368, "uuid": "66e056a8-b246-4f81-96dd-96b23573000c"}, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:37.347 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:37 +0000 (0:00:00.061) 0:02:00.362 **** 2020-02-12T14:09:37.352 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-12T14:09:37.353 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:37.400 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:37 +0000 (0:00:00.052) 0:02:00.414 **** 2020-02-12T14:09:37.405 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-02-12T14:09:37.407 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:37.452 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:37 +0000 (0:00:00.052) 0:02:00.468 **** 2020-02-12T14:09:37.461 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-12T14:09:37.462 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:37.499 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:37 +0000 (0:00:00.046) 0:02:00.514 **** 2020-02-12T14:09:37.505 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-12T14:09:37.507 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:37.545 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:37 +0000 (0:00:00.045) 0:02:00.560 **** 2020-02-12T14:09:37.550 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-02-12T14:09:37.552 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:37.597 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:37 +0000 (0:00:00.051) 0:02:00.611 **** 2020-02-12T14:09:37.604 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-12T14:09:37.605 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:37.642 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:37 +0000 (0:00:00.045) 0:02:00.657 **** 2020-02-12T14:09:37.647 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-02-12T14:09:37.649 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:37.687 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:37 +0000 (0:00:00.044) 0:02:00.702 **** 2020-02-12T14:09:37.695 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-02-12T14:09:37.696 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:37.733 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:37 +0000 (0:00:00.046) 0:02:00.748 **** 2020-02-12T14:09:37.739 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-02-12T14:09:37.741 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:37.778 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:37 +0000 (0:00:00.044) 0:02:00.793 **** 2020-02-12T14:09:37.784 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-02-12T14:09:37.785 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:37.824 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:37 +0000 (0:00:00.045) 0:02:00.839 **** 2020-02-12T14:09:37.850 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-02-12T14:09:37.852 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:37.888 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:37 +0000 (0:00:00.064) 0:02:00.903 **** 2020-02-12T14:09:38.488 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-02-12T14:09:38.491 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} changed: [smithi072.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-02-12T14:09:38.528 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:38 +0000 (0:00:00.640) 0:02:01.543 **** 2020-02-12T14:09:38.561 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:38 +0000 (0:00:00.032) 0:02:01.576 **** 2020-02-12T14:09:39.167 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-02-12T14:09:39.168 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} changed: [smithi072.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-12T14:09:39.514 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-12T14:09:39.536 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-12T14:09:39.865 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-12T14:09:39.866 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-12T14:09:40.191 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-12T14:09:40.202 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-12T14:09:40.539 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-12T14:09:40.546 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-12T14:09:40.582 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:40 +0000 (0:00:02.021) 0:02:03.597 **** 2020-02-12T14:09:40.616 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:40 +0000 (0:00:00.033) 0:02:03.631 **** 2020-02-12T14:09:40.782 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-02-12T14:09:40.790 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-02-12T14:09:40.820 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:40 +0000 (0:00:00.204) 0:02:03.836 **** 2020-02-12T14:09:40.828 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-02-12T14:09:40.876 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:40 +0000 (0:00:00.055) 0:02:03.891 **** 2020-02-12T14:09:40.882 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-02-12T14:09:40.883 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:40.916 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:41.077 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-12T14:09:41.109 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-12T14:09:41.260 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-12T14:09:41.291 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-12T14:09:41.452 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-12T14:09:41.474 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-12T14:09:41.652 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-12T14:09:41.661 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-12T14:09:41.703 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:41 +0000 (0:00:00.826) 0:02:04.718 **** 2020-02-12T14:09:41.737 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:41 +0000 (0:00:00.034) 0:02:04.752 **** 2020-02-12T14:09:41.910 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-02-12T14:09:41.911 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-02-12T14:09:41.955 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:41 +0000 (0:00:00.217) 0:02:04.970 **** 2020-02-12T14:09:41.962 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-02-12T14:09:42.003 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:41 +0000 (0:00:00.048) 0:02:05.018 **** 2020-02-12T14:09:42.007 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-02-12T14:09:42.009 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-02-12T14:09:42.052 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:42 +0000 (0:00:00.049) 0:02:05.067 **** 2020-02-12T14:09:42.059 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-02-12T14:09:42.101 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:42 +0000 (0:00:00.048) 0:02:05.116 **** 2020-02-12T14:09:42.639 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi072.front.sepia.ceph.com] => {"changed": true} changed: [smithi139.front.sepia.ceph.com] => {"changed": true} 2020-02-12T14:09:42.678 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:42 +0000 (0:00:00.576) 0:02:05.693 **** 2020-02-12T14:09:42.724 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:42 +0000 (0:00:00.045) 0:02:05.738 **** 2020-02-12T14:09:43.273 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-02-12T14:09:43.274 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} changed: [smithi072.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-02-12T14:09:43.318 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:43 +0000 (0:00:00.594) 0:02:06.333 **** 2020-02-12T14:09:43.357 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:43 +0000 (0:00:00.038) 0:02:06.372 **** 2020-02-12T14:09:43.361 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-02-12T14:09:43.363 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:43.400 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:43 +0000 (0:00:00.043) 0:02:06.415 **** 2020-02-12T14:09:43.406 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:43.445 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:43 +0000 (0:00:00.045) 0:02:06.460 **** 2020-02-12T14:09:43.450 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-02-12T14:09:43.452 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:43.488 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:43 +0000 (0:00:00.043) 0:02:06.504 **** 2020-02-12T14:09:43.494 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:43.536 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:43 +0000 (0:00:00.047) 0:02:06.551 **** 2020-02-12T14:09:43.542 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-02-12T14:09:43.543 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:43.580 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:43 +0000 (0:00:00.044) 0:02:06.596 **** 2020-02-12T14:09:43.586 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:43.625 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:43 +0000 (0:00:00.044) 0:02:06.640 **** 2020-02-12T14:09:43.630 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-02-12T14:09:43.631 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:43.668 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:43 +0000 (0:00:00.043) 0:02:06.683 **** 2020-02-12T14:09:43.674 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:43.715 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:43 +0000 (0:00:00.046) 0:02:06.730 **** 2020-02-12T14:09:43.723 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-02-12T14:09:43.725 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:43.760 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:43 +0000 (0:00:00.044) 0:02:06.775 **** 2020-02-12T14:09:43.766 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:43.803 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:43 +0000 (0:00:00.042) 0:02:06.818 **** 2020-02-12T14:09:43.808 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-02-12T14:09:43.809 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:43.847 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:43 +0000 (0:00:00.044) 0:02:06.862 **** 2020-02-12T14:09:43.853 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:43.891 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:43 +0000 (0:00:00.044) 0:02:06.907 **** 2020-02-12T14:09:43.896 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-02-12T14:09:43.897 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:43.941 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:43 +0000 (0:00:00.049) 0:02:06.956 **** 2020-02-12T14:09:43.948 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:43.994 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:43 +0000 (0:00:00.053) 0:02:07.010 **** 2020-02-12T14:09:44.002 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-02-12T14:09:44.003 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:44.046 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:44 +0000 (0:00:00.052) 0:02:07.062 **** 2020-02-12T14:09:44.052 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:44.091 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:44 +0000 (0:00:00.044) 0:02:07.107 **** 2020-02-12T14:09:44.097 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-02-12T14:09:44.098 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:44.144 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:44 +0000 (0:00:00.052) 0:02:07.159 **** 2020-02-12T14:09:44.150 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:44.190 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:44 +0000 (0:00:00.046) 0:02:07.206 **** 2020-02-12T14:09:44.198 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-02-12T14:09:44.199 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:44.238 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:44 +0000 (0:00:00.047) 0:02:07.253 **** 2020-02-12T14:09:44.243 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:44.292 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:44 +0000 (0:00:00.054) 0:02:07.308 **** 2020-02-12T14:09:44.297 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-02-12T14:09:44.299 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:44.338 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:44 +0000 (0:00:00.045) 0:02:07.353 **** 2020-02-12T14:09:44.345 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:44.384 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:44 +0000 (0:00:00.046) 0:02:07.399 **** 2020-02-12T14:09:44.824 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-02-12T14:09:44.824 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-02-12T14:09:44.863 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:44 +0000 (0:00:00.478) 0:02:07.878 **** 2020-02-12T14:09:44.869 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-02-12T14:09:44.908 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:44 +0000 (0:00:00.045) 0:02:07.923 **** 2020-02-12T14:09:45.181 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-02-12T14:09:45.183 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2020-02-12 14:07:24 UTC", "ActiveEnterTimestampMonotonic": "11966156", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount ntpd.service ntpdate.service systemd-tmpfiles-setup.service tmp.mount basic.target system.slice systemd-journald.socket sntp.service sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2020-02-12 14:07:23 UTC", "AssertTimestampMonotonic": "10628893", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2020-02-12 14:07:23 UTC", "ConditionTimestampMonotonic": "10628871", "ConfigurationDirectoryMode": "0755", "Conflicts": "ntpd.service systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-02-12T14:09:45.184 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2330", "ExecMainStartTimestamp": "Wed 2020-02-12 14:07:24 UTC", "ExecMainStartTimestampMonotonic": "11903608", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2020-02-12 14:07:23 UTC", "InactiveExitTimestampMonotonic": "10785288", "InvocationID": "8af7ccf269e547b7b9ee4016a649fbb7", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-02-12T14:09:45.186 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127435", "LimitNPROCSoft": "127435", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127435", "LimitSIGPENDINGSoft": "127435", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2330", "MemoryAccounting": "yes", "MemoryCurrent": "2678784", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-02-12T14:09:45.187 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2020-02-12 14:07:24 UTC", "StateChangeTimestampMonotonic": "11966156", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2020-02-12 14:07:24 UTC", "WatchdogTimestampMonotonic": "11903622", "WatchdogUSec": "0"}} 2020-02-12T14:09:45.236 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:45 +0000 (0:00:00.327) 0:02:08.251 **** 2020-02-12T14:09:45.245 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2020-02-12 14:07:06 UTC", "ActiveEnterTimestampMonotonic": "11886179", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "ntpdate.service systemd-journald.socket basic.target tmp.mount systemd-tmpfiles-setup.service sntp.service ntpd.service system.slice -.mount sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2020-02-12 14:07:05 UTC", "AssertTimestampMonotonic": "10498003", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2020-02-12 14:07:05 UTC", "ConditionTimestampMonotonic": "10497976", "ConfigurationDirectoryMode": "0755", "Conflicts": "ntpd.service shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-02-12T14:09:45.246 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2360", "ExecMainStartTimestamp": "Wed 2020-02-12 14:07:06 UTC", "ExecMainStartTimestampMonotonic": "11846655", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2020-02-12 14:07:05 UTC", "InactiveExitTimestampMonotonic": "10817703", "InvocationID": "e27c36240edd43489a11bca8041a3031", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-02-12T14:09:45.248 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127436", "LimitNPROCSoft": "127436", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127436", "LimitSIGPENDINGSoft": "127436", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2360", "MemoryAccounting": "yes", "MemoryCurrent": "2863104", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-02-12T14:09:45.249 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2020-02-12 14:07:06 UTC", "StateChangeTimestampMonotonic": "11886179", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2020-02-12 14:07:06 UTC", "WatchdogTimestampMonotonic": "11846669", "WatchdogUSec": "0"}} 2020-02-12T14:09:45.284 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:45 +0000 (0:00:00.048) 0:02:08.300 **** 2020-02-12T14:09:45.289 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-02-12T14:09:45.289 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:45.338 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:45 +0000 (0:00:00.053) 0:02:08.353 **** 2020-02-12T14:09:45.344 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:45.381 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:45 +0000 (0:00:00.042) 0:02:08.396 **** 2020-02-12T14:09:45.389 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-02-12T14:09:45.391 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:45.427 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:45 +0000 (0:00:00.045) 0:02:08.442 **** 2020-02-12T14:09:45.432 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:45.490 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:45 +0000 (0:00:00.063) 0:02:08.505 **** 2020-02-12T14:09:45.495 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-02-12T14:09:45.496 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:45.534 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:45 +0000 (0:00:00.044) 0:02:08.550 **** 2020-02-12T14:09:45.540 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:45.579 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:45 +0000 (0:00:00.044) 0:02:08.594 **** 2020-02-12T14:09:45.729 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-02-12T14:09:45.730 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "gid": 1209, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-02-12T14:09:45.783 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:45 +0000 (0:00:00.204) 0:02:08.799 **** 2020-02-12T14:09:45.796 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "gid": 1209, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-02-12T14:09:45.856 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:45 +0000 (0:00:00.072) 0:02:08.872 **** 2020-02-12T14:09:46.276 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-02-12T14:09:46.276 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1209, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-02-12T14:09:46.317 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:46 +0000 (0:00:00.460) 0:02:09.332 **** 2020-02-12T14:09:46.333 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1209, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-02-12T14:09:46.374 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:46 +0000 (0:00:00.057) 0:02:09.389 **** 2020-02-12T14:09:47.621 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-02-12T14:09:47.622 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-02-12T14:09:47.661 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:47 +0000 (0:00:01.286) 0:02:10.676 **** 2020-02-12T14:09:47.667 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-02-12T14:09:47.708 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:47 +0000 (0:00:00.047) 0:02:10.723 **** 2020-02-12T14:09:47.714 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-02-12T14:09:47.716 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:47.752 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:47 +0000 (0:00:00.044) 0:02:10.767 **** 2020-02-12T14:09:47.757 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:47.795 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:47 +0000 (0:00:00.042) 0:02:10.810 **** 2020-02-12T14:09:47.803 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-02-12T14:09:47.805 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-02-12T14:09:47.841 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:47 +0000 (0:00:00.045) 0:02:10.856 **** 2020-02-12T14:09:47.847 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-02-12T14:09:47.891 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:47 +0000 (0:00:00.049) 0:02:10.906 **** 2020-02-12T14:09:48.029 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-02-12T14:09:48.030 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-02-12T14:09:48.091 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:48 +0000 (0:00:00.200) 0:02:11.106 **** 2020-02-12T14:09:48.097 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-02-12T14:09:48.135 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:48 +0000 (0:00:00.044) 0:02:11.150 **** 2020-02-12T14:09:48.140 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-02-12T14:09:48.142 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:48.178 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:48 +0000 (0:00:00.043) 0:02:11.193 **** 2020-02-12T14:09:48.186 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:48.239 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:48 +0000 (0:00:00.060) 0:02:11.254 **** 2020-02-12T14:09:48.248 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-02-12T14:09:48.248 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-02-12T14:09:48.287 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:48 +0000 (0:00:00.048) 0:02:11.303 **** 2020-02-12T14:09:48.293 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-02-12T14:09:48.331 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:48 +0000 (0:00:00.043) 0:02:11.347 **** 2020-02-12T14:09:48.337 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-02-12T14:09:48.338 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:48.374 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:48 +0000 (0:00:00.042) 0:02:11.389 **** 2020-02-12T14:09:48.378 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:48.416 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:48 +0000 (0:00:00.042) 0:02:11.431 **** 2020-02-12T14:09:48.565 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-02-12T14:09:48.566 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-02-12T14:09:48.605 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:48 +0000 (0:00:00.189) 0:02:11.620 **** 2020-02-12T14:09:48.622 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-02-12T14:09:48.660 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:48 +0000 (0:00:00.054) 0:02:11.675 **** 2020-02-12T14:09:48.801 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-02-12T14:09:48.802 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-02-12T14:09:48.848 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:48 +0000 (0:00:00.187) 0:02:11.862 **** 2020-02-12T14:09:48.853 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-02-12T14:09:48.894 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:48 +0000 (0:00:00.047) 0:02:11.909 **** 2020-02-12T14:09:48.901 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-02-12T14:09:48.902 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:48.940 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:48 +0000 (0:00:00.045) 0:02:11.955 **** 2020-02-12T14:09:48.954 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:48.998 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:48 +0000 (0:00:00.057) 0:02:12.013 **** 2020-02-12T14:09:49.004 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-02-12T14:09:49.006 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.007 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.007 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.009 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.051 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:49 +0000 (0:00:00.053) 0:02:12.066 **** 2020-02-12T14:09:49.057 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.058 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.059 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi072.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.061 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.107 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:49 +0000 (0:00:00.051) 0:02:12.117 **** 2020-02-12T14:09:49.110 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-02-12T14:09:49.111 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.112 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.113 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.115 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.171 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:49 +0000 (0:00:00.068) 0:02:12.186 **** 2020-02-12T14:09:49.176 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.177 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.178 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.179 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.180 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.217 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:49 +0000 (0:00:00.046) 0:02:12.233 **** 2020-02-12T14:09:49.223 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-12T14:09:49.224 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.267 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:49 +0000 (0:00:00.048) 0:02:12.282 **** 2020-02-12T14:09:49.272 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.313 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:49 +0000 (0:00:00.046) 0:02:12.328 **** 2020-02-12T14:09:49.318 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-02-12T14:09:49.320 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.356 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:49 +0000 (0:00:00.043) 0:02:12.371 **** 2020-02-12T14:09:49.361 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.401 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:49 +0000 (0:00:00.044) 0:02:12.416 **** 2020-02-12T14:09:49.406 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-02-12T14:09:49.408 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.447 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:49 +0000 (0:00:00.045) 0:02:12.462 **** 2020-02-12T14:09:49.452 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.492 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:49 +0000 (0:00:00.045) 0:02:12.507 **** 2020-02-12T14:09:49.497 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-02-12T14:09:49.499 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.536 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:49 +0000 (0:00:00.044) 0:02:12.551 **** 2020-02-12T14:09:49.541 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.580 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:49 +0000 (0:00:00.043) 0:02:12.595 **** 2020-02-12T14:09:49.586 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.625 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:49 +0000 (0:00:00.045) 0:02:12.640 **** 2020-02-12T14:09:49.630 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.669 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:49 +0000 (0:00:00.044) 0:02:12.685 **** 2020-02-12T14:09:49.675 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-02-12T14:09:49.676 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.715 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:49 +0000 (0:00:00.045) 0:02:12.730 **** 2020-02-12T14:09:49.721 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.760 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:49 +0000 (0:00:00.044) 0:02:12.775 **** 2020-02-12T14:09:49.766 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-02-12T14:09:49.767 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.806 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:49 +0000 (0:00:00.045) 0:02:12.821 **** 2020-02-12T14:09:49.811 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.856 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:49 +0000 (0:00:00.050) 0:02:12.872 **** 2020-02-12T14:09:49.862 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-02-12T14:09:49.864 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.904 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:49 +0000 (0:00:00.047) 0:02:12.919 **** 2020-02-12T14:09:49.911 INFO:teuthology.task.ansible.out:skipping: [smithi072.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T14:09:49.950 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:49 +0000 (0:00:00.045) 0:02:12.965 **** 2020-02-12T14:09:50.120 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-02-12T14:09:50.122 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.004941", "end": "2020-02-12 14:09:50.090181", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-02-12 14:09:50.085240", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T14:09:50.173 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.004734", "end": "2020-02-12 14:09:50.135413", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-02-12 14:09:50.130679", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T14:09:50.308 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003151", "end": "2020-02-12 14:09:50.278935", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-02-12 14:09:50.275784", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T14:09:50.361 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003023", "end": "2020-02-12 14:09:50.326957", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-02-12 14:09:50.323934", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T14:09:50.493 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002815", "end": "2020-02-12 14:09:50.460100", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-02-12 14:09:50.457285", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-02-12T14:09:50.536 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002599", "end": "2020-02-12 14:09:50.508153", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-02-12 14:09:50.505554", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-02-12T14:09:50.710 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.031727", "end": "2020-02-12 14:09:50.674402", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-02-12 14:09:50.642675", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T14:09:50.750 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:50 +0000 (0:00:00.799) 0:02:13.765 **** 2020-02-12T14:09:50.757 INFO:teuthology.task.ansible.out:ok: [smithi072.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.019605", "end": "2020-02-12 14:09:50.709155", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-02-12 14:09:50.689550", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T14:09:50.798 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:50 +0000 (0:00:00.047) 0:02:13.813 **** 2020-02-12T14:09:50.803 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-02-12T14:09:50.845 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:50 +0000 (0:00:00.047) 0:02:13.860 **** 2020-02-12T14:09:50.893 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 14:09:50 +0000 (0:00:00.048) 0:02:13.909 **** 2020-02-12T14:09:51.034 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-02-12T14:09:51.034 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-02-12T14:09:51.110 INFO:teuthology.task.ansible.out:changed: [smithi072.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-02-12T14:09:51.205 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-02-12T14:09:51.207 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2020-02-12T14:09:51.209 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2020-02-12T14:09:51.210 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi072.front.sepia.ceph.com : ok=109 changed=33 unreachable=0 failed=0 skipped=172 rescued=0 ignored=3 smithi139.front.sepia.ceph.com : ok=109 changed=33 unreachable=0 failed=0 skipped=172 rescued=0 ignored=3 Wednesday 12 February 2020 14:09:51 +0000 (0:00:00.316) 0:02:14.225 **** =============================================================================== common : nrpe - Remove SELinux policy package -------------------------- 16.37s common : nrpe - Load SELinux policy package ---------------------------- 16.18s 2020-02-12T14:09:51.211 INFO:teuthology.task.ansible.out:testnode : Zap all non-root disks --------------------------------------- 7.90s testnode : Install packages --------------------------------------------- 7.46s testnode : Base group workaround for BZ1782899 -------------------------- 5.55s Gathering Facts --------------------------------------------------------- 3.53s testnode : Ensure ceph dependency packages are not present. ------------- 3.02s testnode : Ensure ceph packages are not present. ------------------------ 3.01s common : Install Kerberos Packages (RedHat) ----------------------------- 2.23s testnode : Create logical volume(s) ------------------------------------- 2.02s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.94s 2020-02-12T14:09:51.211 INFO:teuthology.task.ansible.out:testnode : Rebuild rpmdb ------------------------------------------------ 1.85s testnode : Install packages via pip ------------------------------------- 1.29s common : nrpe - Set SELinux boolean nagios_run_sudo true ---------------- 1.23s testnode : Remove packages ---------------------------------------------- 0.91s testnode : Make sure rpm dependencies are installed --------------------- 0.84s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.84s testnode : Write /scratch_devs ------------------------------------------ 0.83s testnode : List any leftover Ceph artifacts fr 2020-02-12T14:09:51.212 INFO:teuthology.task.ansible.out:om previous jobs ---------- 0.80s testnode : Set the system's hostname ------------------------------------ 0.78s 2020-02-12T14:09:51.487 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi072.front.sepia.ceph.com'), Remote(name='ubuntu@smithi139.front.sepia.ceph.com')] 2020-02-12T14:09:51.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T14:09:51.489 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi072.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:09:51.558 INFO:teuthology.orchestra.run.smithi072:> true 2020-02-12T14:09:51.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T14:09:51.643 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi139.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T14:09:51.711 INFO:teuthology.orchestra.run.smithi139:> true 2020-02-12T14:09:51.801 INFO:teuthology.run_tasks:Running task clock... 2020-02-12T14:09:51.858 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-02-12T14:09:51.858 INFO:teuthology.orchestra.run.smithi072:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-02-12T14:09:51.892 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-02-12T14:09:51.911 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-02-12T14:09:51.950 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: ntpd: command not found 2020-02-12T14:09:51.964 INFO:teuthology.orchestra.run.smithi072.stdout:506 Cannot talk to daemon 2020-02-12T14:09:51.981 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-02-12T14:09:51.998 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-02-12T14:09:52.056 INFO:teuthology.orchestra.run.smithi072.stderr:bash: ntpq: command not found 2020-02-12T14:09:52.059 INFO:teuthology.orchestra.run.smithi072.stdout:210 Number of sources = 4 2020-02-12T14:09:52.059 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-02-12T14:09:52.059 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2020-02-12T14:09:52.059 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-12T14:09:52.059 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-12T14:09:52.060 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-12T14:09:52.060 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-12T14:09:52.060 INFO:teuthology.orchestra.run.smithi139:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-02-12T14:09:52.095 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-02-12T14:09:52.113 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-02-12T14:09:52.158 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: ntpd: command not found 2020-02-12T14:09:52.169 INFO:teuthology.orchestra.run.smithi139.stdout:506 Cannot talk to daemon 2020-02-12T14:09:52.186 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-02-12T14:09:52.204 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-02-12T14:09:52.265 INFO:teuthology.orchestra.run.smithi139.stderr:bash: ntpq: command not found 2020-02-12T14:09:52.269 INFO:teuthology.orchestra.run.smithi139.stdout:210 Number of sources = 4 2020-02-12T14:09:52.269 INFO:teuthology.orchestra.run.smithi139.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-02-12T14:09:52.269 INFO:teuthology.orchestra.run.smithi139.stdout:=============================================================================== 2020-02-12T14:09:52.269 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-12T14:09:52.269 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-12T14:09:52.269 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-12T14:09:52.270 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-12T14:09:52.270 INFO:teuthology.run_tasks:Running task install... 2020-02-12T14:09:52.282 DEBUG:teuthology.task.install:project ceph 2020-02-12T14:09:52.282 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '7df2194963eaa185d198b9c90e899c7e7ae9eb30'}} 2020-02-12T14:09:52.282 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'sha1': '7df2194963eaa185d198b9c90e899c7e7ae9eb30'} 2020-02-12T14:09:52.282 INFO:teuthology.task.install:Using flavor: basic 2020-02-12T14:09:52.290 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-02-12T14:09:52.290 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2020-02-12T14:09:52.291 INFO:teuthology.orchestra.run.smithi072:> sudo lsb_release -is 2020-02-12T14:09:52.327 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS 2020-02-12T14:09:52.328 DEBUG:teuthology.misc:System to be installed: CentOS 2020-02-12T14:09:52.328 INFO:teuthology.orchestra.run.smithi139:> sudo lsb_release -is 2020-02-12T14:09:52.329 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '7df2194963eaa185d198b9c90e899c7e7ae9eb30', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'flavor': 'basic', 'extras': None} 2020-02-12T14:09:52.329 INFO:teuthology.orchestra.run.smithi072:> sudo lsb_release -is 2020-02-12T14:09:52.365 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS 2020-02-12T14:09:52.366 DEBUG:teuthology.misc:System to be installed: CentOS 2020-02-12T14:09:52.366 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '7df2194963eaa185d198b9c90e899c7e7ae9eb30', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'flavor': 'basic', 'extras': None} 2020-02-12T14:09:52.366 INFO:teuthology.orchestra.run.smithi139:> sudo lsb_release -is 2020-02-12T14:09:52.402 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS 2020-02-12T14:09:52.404 DEBUG:teuthology.misc:System to be installed: CentOS 2020-02-12T14:09:52.404 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7df2194963eaa185d198b9c90e899c7e7ae9eb30 2020-02-12T14:09:52.442 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS 2020-02-12T14:09:52.443 DEBUG:teuthology.misc:System to be installed: CentOS 2020-02-12T14:09:52.444 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7df2194963eaa185d198b9c90e899c7e7ae9eb30 2020-02-12T14:09:52.570 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200211.222321/7df2194963eaa185d198b9c90e899c7e7ae9eb30/centos/8/flavors/default/ 2020-02-12T14:09:52.571 INFO:teuthology.task.install.rpm:Package version is 15.1.0-567.g7df2194 2020-02-12T14:09:52.603 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200211.222321/7df2194963eaa185d198b9c90e899c7e7ae9eb30/centos/8/flavors/default/ 2020-02-12T14:09:52.603 INFO:teuthology.task.install.rpm:Package version is 15.1.0-567.g7df2194 2020-02-12T14:09:52.691 INFO:teuthology.orchestra.run.smithi072:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-02-12T14:09:52.718 INFO:teuthology.orchestra.run.smithi139:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-02-12T14:09:52.736 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel on remote rpm x86_64 2020-02-12T14:09:52.736 INFO:teuthology.orchestra.run.smithi072:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7df2194963eaa185d198b9c90e899c7e7ae9eb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-02-12T14:09:52.763 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel on remote rpm x86_64 2020-02-12T14:09:52.763 INFO:teuthology.orchestra.run.smithi139:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7df2194963eaa185d198b9c90e899c7e7ae9eb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-02-12T14:09:52.804 INFO:teuthology.orchestra.run.smithi072:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-02-12T14:09:52.831 INFO:teuthology.orchestra.run.smithi139:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-02-12T14:09:52.884 INFO:teuthology.orchestra.run.smithi072:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-02-12T14:09:52.912 INFO:teuthology.orchestra.run.smithi139:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-02-12T14:09:52.951 INFO:teuthology.orchestra.run.smithi072.stdout:check_obsoletes = 1 2020-02-12T14:09:52.952 INFO:teuthology.orchestra.run.smithi072:> sudo yum clean all 2020-02-12T14:09:52.978 INFO:teuthology.orchestra.run.smithi139.stdout:check_obsoletes = 1 2020-02-12T14:09:52.980 INFO:teuthology.orchestra.run.smithi139:> sudo yum clean all 2020-02-12T14:09:53.325 INFO:teuthology.orchestra.run.smithi072.stdout:235 files removed 2020-02-12T14:09:53.354 INFO:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel 2020-02-12T14:09:53.360 INFO:teuthology.orchestra.run.smithi139.stdout:235 files removed 2020-02-12T14:09:53.389 INFO:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel 2020-02-12T14:09:53.924 INFO:teuthology.orchestra.run.smithi072.stdout:ceph packages for x86_64 297 kB/s | 69 kB 00:00 2020-02-12T14:09:53.946 INFO:teuthology.orchestra.run.smithi139.stdout:ceph packages for x86_64 315 kB/s | 69 kB 00:00 2020-02-12T14:09:54.140 INFO:teuthology.orchestra.run.smithi072.stdout:ceph noarch packages 65 kB/s | 12 kB 00:00 2020-02-12T14:09:54.159 INFO:teuthology.orchestra.run.smithi139.stdout:ceph noarch packages 66 kB/s | 12 kB 00:00 2020-02-12T14:09:54.344 INFO:teuthology.orchestra.run.smithi072.stdout:ceph source packages 7.5 kB/s | 1.4 kB 00:00 2020-02-12T14:09:54.361 INFO:teuthology.orchestra.run.smithi139.stdout:ceph source packages 7.6 kB/s | 1.4 kB 00:00 2020-02-12T14:09:56.277 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS-8 - AppStream 3.4 MB/s | 6.4 MB 00:01 2020-02-12T14:09:56.301 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS-8 - AppStream 3.3 MB/s | 6.4 MB 00:01 2020-02-12T14:09:58.175 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS-8 - Base 5.7 MB/s | 5.0 MB 00:00 2020-02-12T14:09:59.008 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS-8 - Base 2.9 MB/s | 5.0 MB 00:01 2020-02-12T14:09:59.778 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS-8 - Extras 2.3 kB/s | 2.1 kB 00:00 2020-02-12T14:10:00.250 INFO:teuthology.orchestra.run.smithi072.stdout:Copr repo for ceph-el8 owned by ktdreyer 89 kB/s | 38 kB 00:00 2020-02-12T14:10:00.600 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS-8 - Extras 2.4 kB/s | 2.1 kB 00:00 2020-02-12T14:10:00.848 INFO:teuthology.orchestra.run.smithi139.stdout:Copr repo for ceph-el8 owned by ktdreyer 187 kB/s | 38 kB 00:00 2020-02-12T14:10:01.840 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 3.7 MB/s | 5.6 MB 00:01 2020-02-12T14:10:02.375 INFO:teuthology.orchestra.run.smithi139.stdout:Extra Packages for Enterprise Linux 3.8 MB/s | 5.6 MB 00:01 2020-02-12T14:10:03.021 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 5.7 MB/s | 33 kB 00:00 2020-02-12T14:10:03.531 INFO:teuthology.orchestra.run.smithi139.stdout:lab-extras 6.0 MB/s | 33 kB 00:00 2020-02-12T14:10:03.913 INFO:teuthology.orchestra.run.smithi072.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-02-12T14:10:03.913 INFO:teuthology.orchestra.run.smithi072.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-02-12T14:10:03.916 INFO:teuthology.orchestra.run.smithi072.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-02-12T14:10:03.917 INFO:teuthology.orchestra.run.smithi072.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-02-12T14:10:03.918 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-02-12T14:10:03.918 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-02-12T14:10:04.033 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2020-02-12T14:10:04.045 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2020-02-12T14:10:04.045 INFO:teuthology.orchestra.run.smithi072.stdout: Package ArchVersion Repository Size 2020-02-12T14:10:04.045 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2020-02-12T14:10:04.045 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2020-02-12T14:10:04.045 INFO:teuthology.orchestra.run.smithi072.stdout: ceph x86_642:15.1.0-567.g7df2194.el8 ceph 6.4 k 2020-02-12T14:10:04.046 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base x86_642:15.1.0-567.g7df2194.el8 ceph 5.5 M 2020-02-12T14:10:04.046 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse x86_642:15.1.0-567.g7df2194.el8 ceph 571 k 2020-02-12T14:10:04.046 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache x86_642:15.1.0-567.g7df2194.el8 ceph 202 k 2020-02-12T14:10:04.046 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr x86_642:15.1.0-567.g7df2194.el8 ceph 1.5 M 2020-02-12T14:10:04.046 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw x86_642:15.1.0-567.g7df2194.el8 ceph 9.7 M 2020-02-12T14:10:04.046 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test x86_642:15.1.0-567.g7df2194.el8 ceph 41 M 2020-02-12T14:10:04.046 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm x86_642:15.1.0-567.g7df2194.el8 ceph 32 k 2020-02-12T14:10:04.047 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel x86_642:15.1.0-567.g7df2194.el8 ceph 21 k 2020-02-12T14:10:04.047 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2 x86_642:15.1.0-567.g7df2194.el8 ceph 507 k 2020-02-12T14:10:04.047 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel x86_642:15.1.0-567.g7df2194.el8 ceph 141 k 2020-02-12T14:10:04.047 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs x86_642:15.1.0-567.g7df2194.el8 ceph 149 k 2020-02-12T14:10:04.047 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados x86_642:15.1.0-567.g7df2194.el8 ceph 351 k 2020-02-12T14:10:04.047 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd x86_642:15.1.0-567.g7df2194.el8 ceph 309 k 2020-02-12T14:10:04.048 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw x86_642:15.1.0-567.g7df2194.el8 ceph 113 k 2020-02-12T14:10:04.048 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse x86_642:15.1.0-567.g7df2194.el8 ceph 72 k 2020-02-12T14:10:04.048 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror x86_642:15.1.0-567.g7df2194.el8 ceph 2.6 M 2020-02-12T14:10:04.048 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd x86_642:15.1.0-567.g7df2194.el8 ceph 141 k 2020-02-12T14:10:04.048 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm noarch2:15.1.0-567.g7df2194.el8 ceph-noarch 29 k 2020-02-12T14:10:04.048 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard noarch2:15.1.0-567.g7df2194.el8 ceph-noarch 3.8 M 2020-02-12T14:10:04.048 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local noarch2:15.1.0-567.g7df2194.el8 ceph-noarch 8.6 M 2020-02-12T14:10:04.049 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook noarch2:15.1.0-567.g7df2194.el8 ceph-noarch 17 k 2020-02-12T14:10:04.049 INFO:teuthology.orchestra.run.smithi072.stdout: bison x86_643.0.4-10.el8 AppStream 688 k 2020-02-12T14:10:04.049 INFO:teuthology.orchestra.run.smithi072.stdout: flex x86_642.6.1-9.el8 AppStream 320 k 2020-02-12T14:10:04.049 INFO:teuthology.orchestra.run.smithi072.stdout: libtool x86_642.4.6-25.el8 AppStream 709 k 2020-02-12T14:10:04.049 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel x86_640.176-5.el8 BaseOS 54 k 2020-02-12T14:10:04.050 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel x86_640.3.112-1.el8 BaseOS 19 k 2020-02-12T14:10:04.050 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel x86_642.32.1-17.el8 BaseOS 95 k 2020-02-12T14:10:04.050 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel x86_641:1.1.1c-2.el8 BaseOS 2.3 M 2020-02-12T14:10:04.050 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel x86_645.0.0-1.el8 BaseOS 69 k 2020-02-12T14:10:04.050 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2020-02-12T14:10:04.051 INFO:teuthology.orchestra.run.smithi072.stdout: librados2 x86_642:15.1.0-567.g7df2194.el8 ceph 3.6 M 2020-02-12T14:10:04.051 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1 x86_642:15.1.0-567.g7df2194.el8 ceph 1.9 M 2020-02-12T14:10:04.051 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2020-02-12T14:10:04.052 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common x86_642:15.1.0-567.g7df2194.el8 ceph 21 M 2020-02-12T14:10:04.052 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds x86_642:15.1.0-567.g7df2194.el8 ceph 2.0 M 2020-02-12T14:10:04.052 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon x86_642:15.1.0-567.g7df2194.el8 ceph 4.3 M 2020-02-12T14:10:04.052 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd x86_642:15.1.0-567.g7df2194.el8 ceph 17 M 2020-02-12T14:10:04.052 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux x86_642:15.1.0-567.g7df2194.el8 ceph 25 k 2020-02-12T14:10:04.052 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1 x86_642:15.1.0-567.g7df2194.el8 ceph 377 k 2020-02-12T14:10:04.052 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2 x86_642:15.1.0-567.g7df2194.el8 ceph 6.2 M 2020-02-12T14:10:04.053 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse x86_642:15.1.0-567.g7df2194.el8 ceph 40 k 2020-02-12T14:10:04.053 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common x86_642:15.1.0-567.g7df2194.el8 ceph 51 k 2020-02-12T14:10:04.053 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards noarch2:15.1.0-567.g7df2194.el8 ceph-noarch 22 k 2020-02-12T14:10:04.053 INFO:teuthology.orchestra.run.smithi072.stdout: automake noarch1.16.1-6.el8 AppStream 713 k 2020-02-12T14:10:04.053 INFO:teuthology.orchestra.run.smithi072.stdout: jq x86_641.5-12.el8 AppStream 161 k 2020-02-12T14:10:04.053 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka x86_640.11.4-1.el8 AppStream 353 k 2020-02-12T14:10:04.053 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust x86_642.8.1-11.el8 AppStream 259 k 2020-02-12T14:10:04.054 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma x86_646.8.2-1.el8 AppStream 188 k 2020-02-12T14:10:04.054 INFO:teuthology.orchestra.run.smithi072.stdout: openblas x86_640.3.3-2.el8 AppStream 4.3 M 2020-02-12T14:10:04.054 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-threads x86_640.3.3-2.el8 AppStream 4.4 M 2020-02-12T14:10:04.054 INFO:teuthology.orchestra.run.smithi072.stdout: python3-lxml x86_644.2.3-1.el8 AppStream 1.5 M 2020-02-12T14:10:04.054 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako noarch1.0.6-13.el8 AppStream 157 k 2020-02-12T14:10:04.054 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe x86_640.23-19.el8 AppStream 39 k 2020-02-12T14:10:04.055 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy x86_641:1.14.3-9.el8 AppStream 3.7 M 2020-02-12T14:10:04.055 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 AppStream 225 k 2020-02-12T14:10:04.055 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable noarch0.7.2-14.el8 AppStream 44 k 2020-02-12T14:10:04.055 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1 noarch0.3.7-6.el8 AppStream 126 k 2020-02-12T14:10:04.055 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 AppStream 110 k 2020-02-12T14:10:04.055 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz noarch2017.2-9.el8 AppStream 54 k 2020-02-12T14:10:04.056 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f AppStream 15 M 2020-02-12T14:10:04.056 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webencodings noarch0.5.1-6.el8 AppStream 27 k 2020-02-12T14:10:04.056 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug noarch0.12.2-4.el8 AppStream 457 k 2020-02-12T14:10:04.056 INFO:teuthology.orchestra.run.smithi072.stdout: socat x86_641.7.3.2-6.el8 AppStream 298 k 2020-02-12T14:10:04.056 INFO:teuthology.orchestra.run.smithi072.stdout: fuse x86_642.9.7-12.el8 BaseOS 82 k 2020-02-12T14:10:04.056 INFO:teuthology.orchestra.run.smithi072.stdout: fuse-common x86_643.2.1-12.el8 BaseOS 21 k 2020-02-12T14:10:04.056 INFO:teuthology.orchestra.run.smithi072.stdout: keyutils-libs-devel x86_641.5.10-6.el8 BaseOS 48 k 2020-02-12T14:10:04.057 INFO:teuthology.orchestra.run.smithi072.stdout: krb5-devel x86_641.17-9.el8 BaseOS 548 k 2020-02-12T14:10:04.057 INFO:teuthology.orchestra.run.smithi072.stdout: libcom_err-devel x86_641.44.6-3.el8 BaseOS 38 k 2020-02-12T14:10:04.057 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran x86_648.3.1-4.5.el8 BaseOS 638 k 2020-02-12T14:10:04.057 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath x86_648.3.1-4.5.el8 BaseOS 169 k 2020-02-12T14:10:04.057 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq x86_640.9.0-1.el8 BaseOS 47 k 2020-02-12T14:10:04.057 INFO:teuthology.orchestra.run.smithi072.stdout: libselinux-devel x86_642.9-2.1.el8 BaseOS 199 k 2020-02-12T14:10:04.058 INFO:teuthology.orchestra.run.smithi072.stdout: libsepol-devel x86_642.9-1.el8 BaseOS 86 k 2020-02-12T14:10:04.058 INFO:teuthology.orchestra.run.smithi072.stdout: libverto-devel x86_640.3.0-5.el8 BaseOS 18 k 2020-02-12T14:10:04.058 INFO:teuthology.orchestra.run.smithi072.stdout: libxslt x86_641.1.32-3.el8 BaseOS 249 k 2020-02-12T14:10:04.058 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-devel x86_6410.32-1.el8 BaseOS 605 k 2020-02-12T14:10:04.058 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf16 x86_6410.32-1.el8 BaseOS 228 k 2020-02-12T14:10:04.058 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf32 x86_6410.32-1.el8 BaseOS 220 k 2020-02-12T14:10:04.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-chardet noarch3.0.4-7.el8 BaseOS 195 k 2020-02-12T14:10:04.059 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt noarch1.6.1-2.el8 BaseOS 43 k 2020-02-12T14:10:04.059 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib noarch2.1.0-1.el8 BaseOS 155 k 2020-02-12T14:10:04.059 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pysocks noarch1.6.8-3.el8 BaseOS 34 k 2020-02-12T14:10:04.059 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests noarch2.20.0-2.1.el8_1 BaseOS 123 k 2020-02-12T14:10:04.059 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 BaseOS 43 k 2020-02-12T14:10:04.059 INFO:teuthology.orchestra.run.smithi072.stdout: python3-urllib3 noarch1.24.2-2.el8 BaseOS 176 k 2020-02-12T14:10:04.060 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel x86_641.2.11-10.el8 BaseOS 56 k 2020-02-12T14:10:04.060 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot noarch8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-02-12T14:10:04.060 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy noarch18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-02-12T14:10:04.060 INFO:teuthology.orchestra.run.smithi072.stdout: python3-execnet noarch1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-02-12T14:10:04.060 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco noarch6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-02-12T14:10:04.060 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools noarch2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-02-12T14:10:04.060 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils noarch0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-02-12T14:10:04.061 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools noarch7.2.0-3.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-02-12T14:10:04.061 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan noarch1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-02-12T14:10:04.061 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend noarch2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-02-12T14:10:04.061 INFO:teuthology.orchestra.run.smithi072.stdout: python3-remoto noarch1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-02-12T14:10:04.062 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru noarch0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-02-12T14:10:04.062 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes noarch2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-02-12T14:10:04.062 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric noarch0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-02-12T14:10:04.062 INFO:teuthology.orchestra.run.smithi072.stdout: python3-singledispatch noarch3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-02-12T14:10:04.062 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora noarch1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-02-12T14:10:04.062 INFO:teuthology.orchestra.run.smithi072.stdout: python3-trustme noarch0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-02-12T14:10:04.063 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile noarch2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-02-12T14:10:04.063 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-02-12T14:10:04.063 INFO:teuthology.orchestra.run.smithi072.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-02-12T14:10:04.063 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-02-12T14:10:04.063 INFO:teuthology.orchestra.run.smithi072.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-02-12T14:10:04.063 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-02-12T14:10:04.063 INFO:teuthology.orchestra.run.smithi072.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-02-12T14:10:04.064 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-02-12T14:10:04.064 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-02-12T14:10:04.064 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-02-12T14:10:04.064 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes noarch10.0.1-1.el8 epel 1.1 M 2020-02-12T14:10:04.065 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa noarch3.4.2-12.el8 epel 73 k 2020-02-12T14:10:04.065 INFO:teuthology.orchestra.run.smithi072.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-02-12T14:10:04.065 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-02-12T14:10:04.065 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-02-12T14:10:04.065 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-02-12T14:10:04.065 INFO:teuthology.orchestra.run.smithi072.stdout: leveldb x86_641.21-2.el8 lab-extras 179 k 2020-02-12T14:10:04.065 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet x86_641.6.1-13.el8 lab-extras 69 k 2020-02-12T14:10:04.066 INFO:teuthology.orchestra.run.smithi072.stdout:Installing weak dependencies: 2020-02-12T14:10:04.066 INFO:teuthology.orchestra.run.smithi072.stdout: python3-html5lib noarch1:0.999999999-6.el8 AppStream 214 k 2020-02-12T14:10:04.066 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-02-12T14:10:04.066 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:10:04.066 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2020-02-12T14:10:04.066 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2020-02-12T14:10:04.066 INFO:teuthology.orchestra.run.smithi072.stdout:Install 119 Packages 2020-02-12T14:10:04.067 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 2 Packages 2020-02-12T14:10:04.067 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:10:04.067 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 176 M 2020-02-12T14:10:04.067 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2020-02-12T14:10:04.411 INFO:teuthology.orchestra.run.smithi139.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-02-12T14:10:04.412 INFO:teuthology.orchestra.run.smithi139.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-02-12T14:10:04.414 INFO:teuthology.orchestra.run.smithi139.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-02-12T14:10:04.415 INFO:teuthology.orchestra.run.smithi139.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-02-12T14:10:04.416 INFO:teuthology.orchestra.run.smithi139.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-02-12T14:10:04.416 INFO:teuthology.orchestra.run.smithi139.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-02-12T14:10:04.532 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2020-02-12T14:10:04.544 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2020-02-12T14:10:04.544 INFO:teuthology.orchestra.run.smithi139.stdout: Package ArchVersion Repository Size 2020-02-12T14:10:04.544 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2020-02-12T14:10:04.544 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2020-02-12T14:10:04.544 INFO:teuthology.orchestra.run.smithi139.stdout: ceph x86_642:15.1.0-567.g7df2194.el8 ceph 6.4 k 2020-02-12T14:10:04.545 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base x86_642:15.1.0-567.g7df2194.el8 ceph 5.5 M 2020-02-12T14:10:04.545 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse x86_642:15.1.0-567.g7df2194.el8 ceph 571 k 2020-02-12T14:10:04.545 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache x86_642:15.1.0-567.g7df2194.el8 ceph 202 k 2020-02-12T14:10:04.545 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr x86_642:15.1.0-567.g7df2194.el8 ceph 1.5 M 2020-02-12T14:10:04.545 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw x86_642:15.1.0-567.g7df2194.el8 ceph 9.7 M 2020-02-12T14:10:04.545 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test x86_642:15.1.0-567.g7df2194.el8 ceph 41 M 2020-02-12T14:10:04.545 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm x86_642:15.1.0-567.g7df2194.el8 ceph 32 k 2020-02-12T14:10:04.546 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel x86_642:15.1.0-567.g7df2194.el8 ceph 21 k 2020-02-12T14:10:04.546 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2 x86_642:15.1.0-567.g7df2194.el8 ceph 507 k 2020-02-12T14:10:04.546 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel x86_642:15.1.0-567.g7df2194.el8 ceph 141 k 2020-02-12T14:10:04.546 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs x86_642:15.1.0-567.g7df2194.el8 ceph 149 k 2020-02-12T14:10:04.546 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados x86_642:15.1.0-567.g7df2194.el8 ceph 351 k 2020-02-12T14:10:04.546 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd x86_642:15.1.0-567.g7df2194.el8 ceph 309 k 2020-02-12T14:10:04.546 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw x86_642:15.1.0-567.g7df2194.el8 ceph 113 k 2020-02-12T14:10:04.547 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse x86_642:15.1.0-567.g7df2194.el8 ceph 72 k 2020-02-12T14:10:04.547 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror x86_642:15.1.0-567.g7df2194.el8 ceph 2.6 M 2020-02-12T14:10:04.547 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd x86_642:15.1.0-567.g7df2194.el8 ceph 141 k 2020-02-12T14:10:04.547 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm noarch2:15.1.0-567.g7df2194.el8 ceph-noarch 29 k 2020-02-12T14:10:04.547 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard noarch2:15.1.0-567.g7df2194.el8 ceph-noarch 3.8 M 2020-02-12T14:10:04.547 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local noarch2:15.1.0-567.g7df2194.el8 ceph-noarch 8.6 M 2020-02-12T14:10:04.547 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook noarch2:15.1.0-567.g7df2194.el8 ceph-noarch 17 k 2020-02-12T14:10:04.548 INFO:teuthology.orchestra.run.smithi139.stdout: bison x86_643.0.4-10.el8 AppStream 688 k 2020-02-12T14:10:04.548 INFO:teuthology.orchestra.run.smithi139.stdout: flex x86_642.6.1-9.el8 AppStream 320 k 2020-02-12T14:10:04.548 INFO:teuthology.orchestra.run.smithi139.stdout: libtool x86_642.4.6-25.el8 AppStream 709 k 2020-02-12T14:10:04.548 INFO:teuthology.orchestra.run.smithi139.stdout: elfutils-libelf-devel x86_640.176-5.el8 BaseOS 54 k 2020-02-12T14:10:04.548 INFO:teuthology.orchestra.run.smithi139.stdout: libaio-devel x86_640.3.112-1.el8 BaseOS 19 k 2020-02-12T14:10:04.548 INFO:teuthology.orchestra.run.smithi139.stdout: libuuid-devel x86_642.32.1-17.el8 BaseOS 95 k 2020-02-12T14:10:04.548 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-devel x86_641:1.1.1c-2.el8 BaseOS 2.3 M 2020-02-12T14:10:04.549 INFO:teuthology.orchestra.run.smithi139.stdout: xfsprogs-devel x86_645.0.0-1.el8 BaseOS 69 k 2020-02-12T14:10:04.549 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrading: 2020-02-12T14:10:04.549 INFO:teuthology.orchestra.run.smithi139.stdout: librados2 x86_642:15.1.0-567.g7df2194.el8 ceph 3.6 M 2020-02-12T14:10:04.549 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1 x86_642:15.1.0-567.g7df2194.el8 ceph 1.9 M 2020-02-12T14:10:04.549 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2020-02-12T14:10:04.549 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common x86_642:15.1.0-567.g7df2194.el8 ceph 21 M 2020-02-12T14:10:04.550 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds x86_642:15.1.0-567.g7df2194.el8 ceph 2.0 M 2020-02-12T14:10:04.550 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon x86_642:15.1.0-567.g7df2194.el8 ceph 4.3 M 2020-02-12T14:10:04.550 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd x86_642:15.1.0-567.g7df2194.el8 ceph 17 M 2020-02-12T14:10:04.550 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux x86_642:15.1.0-567.g7df2194.el8 ceph 25 k 2020-02-12T14:10:04.550 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1 x86_642:15.1.0-567.g7df2194.el8 ceph 377 k 2020-02-12T14:10:04.550 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2 x86_642:15.1.0-567.g7df2194.el8 ceph 6.2 M 2020-02-12T14:10:04.550 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse x86_642:15.1.0-567.g7df2194.el8 ceph 40 k 2020-02-12T14:10:04.551 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common x86_642:15.1.0-567.g7df2194.el8 ceph 51 k 2020-02-12T14:10:04.551 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards noarch2:15.1.0-567.g7df2194.el8 ceph-noarch 22 k 2020-02-12T14:10:04.551 INFO:teuthology.orchestra.run.smithi139.stdout: automake noarch1.16.1-6.el8 AppStream 713 k 2020-02-12T14:10:04.551 INFO:teuthology.orchestra.run.smithi139.stdout: jq x86_641.5-12.el8 AppStream 161 k 2020-02-12T14:10:04.552 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka x86_640.11.4-1.el8 AppStream 353 k 2020-02-12T14:10:04.552 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust x86_642.8.1-11.el8 AppStream 259 k 2020-02-12T14:10:04.552 INFO:teuthology.orchestra.run.smithi139.stdout: oniguruma x86_646.8.2-1.el8 AppStream 188 k 2020-02-12T14:10:04.552 INFO:teuthology.orchestra.run.smithi139.stdout: openblas x86_640.3.3-2.el8 AppStream 4.3 M 2020-02-12T14:10:04.552 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-threads x86_640.3.3-2.el8 AppStream 4.4 M 2020-02-12T14:10:04.552 INFO:teuthology.orchestra.run.smithi139.stdout: python3-lxml x86_644.2.3-1.el8 AppStream 1.5 M 2020-02-12T14:10:04.552 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako noarch1.0.6-13.el8 AppStream 157 k 2020-02-12T14:10:04.553 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe x86_640.23-19.el8 AppStream 39 k 2020-02-12T14:10:04.553 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy x86_641:1.14.3-9.el8 AppStream 3.7 M 2020-02-12T14:10:04.553 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 AppStream 225 k 2020-02-12T14:10:04.553 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable noarch0.7.2-14.el8 AppStream 44 k 2020-02-12T14:10:04.553 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1 noarch0.3.7-6.el8 AppStream 126 k 2020-02-12T14:10:04.553 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 AppStream 110 k 2020-02-12T14:10:04.553 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz noarch2017.2-9.el8 AppStream 54 k 2020-02-12T14:10:04.553 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f AppStream 15 M 2020-02-12T14:10:04.554 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webencodings noarch0.5.1-6.el8 AppStream 27 k 2020-02-12T14:10:04.554 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug noarch0.12.2-4.el8 AppStream 457 k 2020-02-12T14:10:04.554 INFO:teuthology.orchestra.run.smithi139.stdout: socat x86_641.7.3.2-6.el8 AppStream 298 k 2020-02-12T14:10:04.554 INFO:teuthology.orchestra.run.smithi139.stdout: fuse x86_642.9.7-12.el8 BaseOS 82 k 2020-02-12T14:10:04.554 INFO:teuthology.orchestra.run.smithi139.stdout: fuse-common x86_643.2.1-12.el8 BaseOS 21 k 2020-02-12T14:10:04.554 INFO:teuthology.orchestra.run.smithi139.stdout: keyutils-libs-devel x86_641.5.10-6.el8 BaseOS 48 k 2020-02-12T14:10:04.555 INFO:teuthology.orchestra.run.smithi139.stdout: krb5-devel x86_641.17-9.el8 BaseOS 548 k 2020-02-12T14:10:04.555 INFO:teuthology.orchestra.run.smithi139.stdout: libcom_err-devel x86_641.44.6-3.el8 BaseOS 38 k 2020-02-12T14:10:04.555 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran x86_648.3.1-4.5.el8 BaseOS 638 k 2020-02-12T14:10:04.555 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath x86_648.3.1-4.5.el8 BaseOS 169 k 2020-02-12T14:10:04.555 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq x86_640.9.0-1.el8 BaseOS 47 k 2020-02-12T14:10:04.555 INFO:teuthology.orchestra.run.smithi139.stdout: libselinux-devel x86_642.9-2.1.el8 BaseOS 199 k 2020-02-12T14:10:04.555 INFO:teuthology.orchestra.run.smithi139.stdout: libsepol-devel x86_642.9-1.el8 BaseOS 86 k 2020-02-12T14:10:04.556 INFO:teuthology.orchestra.run.smithi139.stdout: libverto-devel x86_640.3.0-5.el8 BaseOS 18 k 2020-02-12T14:10:04.556 INFO:teuthology.orchestra.run.smithi139.stdout: libxslt x86_641.1.32-3.el8 BaseOS 249 k 2020-02-12T14:10:04.556 INFO:teuthology.orchestra.run.smithi139.stdout: pcre2-devel x86_6410.32-1.el8 BaseOS 605 k 2020-02-12T14:10:04.556 INFO:teuthology.orchestra.run.smithi139.stdout: pcre2-utf16 x86_6410.32-1.el8 BaseOS 228 k 2020-02-12T14:10:04.556 INFO:teuthology.orchestra.run.smithi139.stdout: pcre2-utf32 x86_6410.32-1.el8 BaseOS 220 k 2020-02-12T14:10:04.556 INFO:teuthology.orchestra.run.smithi139.stdout: python3-chardet noarch3.0.4-7.el8 BaseOS 195 k 2020-02-12T14:10:04.556 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jwt noarch1.6.1-2.el8 BaseOS 43 k 2020-02-12T14:10:04.556 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib noarch2.1.0-1.el8 BaseOS 155 k 2020-02-12T14:10:04.557 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pysocks noarch1.6.8-3.el8 BaseOS 34 k 2020-02-12T14:10:04.557 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests noarch2.20.0-2.1.el8_1 BaseOS 123 k 2020-02-12T14:10:04.557 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 BaseOS 43 k 2020-02-12T14:10:04.558 INFO:teuthology.orchestra.run.smithi139.stdout: python3-urllib3 noarch1.24.2-2.el8 BaseOS 176 k 2020-02-12T14:10:04.558 INFO:teuthology.orchestra.run.smithi139.stdout: zlib-devel x86_641.2.11-10.el8 BaseOS 56 k 2020-02-12T14:10:04.558 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot noarch8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-02-12T14:10:04.558 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy noarch18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-02-12T14:10:04.558 INFO:teuthology.orchestra.run.smithi139.stdout: python3-execnet noarch1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-02-12T14:10:04.559 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco noarch6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-02-12T14:10:04.559 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools noarch2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-02-12T14:10:04.559 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils noarch0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-02-12T14:10:04.559 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools noarch7.2.0-3.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-02-12T14:10:04.559 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan noarch1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-02-12T14:10:04.559 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend noarch2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-02-12T14:10:04.559 INFO:teuthology.orchestra.run.smithi139.stdout: python3-remoto noarch1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-02-12T14:10:04.560 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru noarch0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-02-12T14:10:04.560 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes noarch2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-02-12T14:10:04.560 INFO:teuthology.orchestra.run.smithi139.stdout: python3-simplegeneric noarch0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-02-12T14:10:04.560 INFO:teuthology.orchestra.run.smithi139.stdout: python3-singledispatch noarch3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-02-12T14:10:04.560 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora noarch1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-02-12T14:10:04.560 INFO:teuthology.orchestra.run.smithi139.stdout: python3-trustme noarch0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-02-12T14:10:04.560 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile noarch2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-02-12T14:10:04.561 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-02-12T14:10:04.561 INFO:teuthology.orchestra.run.smithi139.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-02-12T14:10:04.561 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-02-12T14:10:04.561 INFO:teuthology.orchestra.run.smithi139.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-02-12T14:10:04.561 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-02-12T14:10:04.561 INFO:teuthology.orchestra.run.smithi139.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-02-12T14:10:04.562 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-02-12T14:10:04.562 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-02-12T14:10:04.562 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-02-12T14:10:04.562 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes noarch10.0.1-1.el8 epel 1.1 M 2020-02-12T14:10:04.562 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa noarch3.4.2-12.el8 epel 73 k 2020-02-12T14:10:04.562 INFO:teuthology.orchestra.run.smithi139.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-02-12T14:10:04.562 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-02-12T14:10:04.563 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-02-12T14:10:04.563 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-02-12T14:10:04.563 INFO:teuthology.orchestra.run.smithi139.stdout: leveldb x86_641.21-2.el8 lab-extras 179 k 2020-02-12T14:10:04.563 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet x86_641.6.1-13.el8 lab-extras 69 k 2020-02-12T14:10:04.563 INFO:teuthology.orchestra.run.smithi139.stdout:Installing weak dependencies: 2020-02-12T14:10:04.563 INFO:teuthology.orchestra.run.smithi139.stdout: python3-html5lib noarch1:0.999999999-6.el8 AppStream 214 k 2020-02-12T14:10:04.563 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-02-12T14:10:04.564 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:10:04.564 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2020-02-12T14:10:04.564 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2020-02-12T14:10:04.564 INFO:teuthology.orchestra.run.smithi139.stdout:Install 119 Packages 2020-02-12T14:10:04.564 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrade 2 Packages 2020-02-12T14:10:04.564 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:10:04.565 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 176 M 2020-02-12T14:10:04.565 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2020-02-12T14:10:05.605 INFO:teuthology.orchestra.run.smithi072.stdout:(1/121): ceph-15.1.0-567.g7df2194.el8.x86_64.rp 63 kB/s | 6.4 kB 00:00 2020-02-12T14:10:05.953 INFO:teuthology.orchestra.run.smithi072.stdout:(2/121): ceph-fuse-15.1.0-567.g7df2194.el8.x86_ 1.6 MB/s | 571 kB 00:00 2020-02-12T14:10:06.109 INFO:teuthology.orchestra.run.smithi072.stdout:(3/121): ceph-immutable-object-cache-15.1.0-567 1.3 MB/s | 202 kB 00:00 2020-02-12T14:10:06.290 INFO:teuthology.orchestra.run.smithi072.stdout:(4/121): ceph-base-15.1.0-567.g7df2194.el8.x86_ 6.9 MB/s | 5.5 MB 00:00 2020-02-12T14:10:06.412 INFO:teuthology.orchestra.run.smithi072.stdout:(5/121): ceph-mds-15.1.0-567.g7df2194.el8.x86_6 6.7 MB/s | 2.0 MB 00:00 2020-02-12T14:10:06.423 INFO:teuthology.orchestra.run.smithi072.stdout:(6/121): ceph-mgr-15.1.0-567.g7df2194.el8.x86_6 12 MB/s | 1.5 MB 00:00 2020-02-12T14:10:07.083 INFO:teuthology.orchestra.run.smithi072.stdout:(7/121): ceph-mon-15.1.0-567.g7df2194.el8.x86_6 6.5 MB/s | 4.3 MB 00:00 2020-02-12T14:10:07.432 INFO:teuthology.orchestra.run.smithi139.stdout:(1/121): ceph-15.1.0-567.g7df2194.el8.x86_64.rp 45 kB/s | 6.4 kB 00:00 2020-02-12T14:10:07.686 INFO:teuthology.orchestra.run.smithi139.stdout:(2/121): ceph-fuse-15.1.0-567.g7df2194.el8.x86_ 2.2 MB/s | 571 kB 00:00 2020-02-12T14:10:07.759 INFO:teuthology.orchestra.run.smithi139.stdout:(3/121): ceph-immutable-object-cache-15.1.0-567 2.7 MB/s | 202 kB 00:00 2020-02-12T14:10:08.425 INFO:teuthology.orchestra.run.smithi072.stdout:(8/121): ceph-osd-15.1.0-567.g7df2194.el8.x86_6 8.3 MB/s | 17 MB 00:02 2020-02-12T14:10:08.522 INFO:teuthology.orchestra.run.smithi139.stdout:(4/121): ceph-mds-15.1.0-567.g7df2194.el8.x86_6 2.6 MB/s | 2.0 MB 00:00 2020-02-12T14:10:08.591 INFO:teuthology.orchestra.run.smithi072.stdout:(9/121): ceph-common-15.1.0-567.g7df2194.el8.x8 6.7 MB/s | 21 MB 00:03 2020-02-12T14:10:08.809 INFO:teuthology.orchestra.run.smithi139.stdout:(5/121): ceph-mgr-15.1.0-567.g7df2194.el8.x86_6 5.4 MB/s | 1.5 MB 00:00 2020-02-12T14:10:08.831 INFO:teuthology.orchestra.run.smithi139.stdout:(6/121): ceph-base-15.1.0-567.g7df2194.el8.x86_ 3.5 MB/s | 5.5 MB 00:01 2020-02-12T14:10:09.507 INFO:teuthology.orchestra.run.smithi139.stdout:(7/121): ceph-mon-15.1.0-567.g7df2194.el8.x86_6 6.2 MB/s | 4.3 MB 00:00 2020-02-12T14:10:10.761 INFO:teuthology.orchestra.run.smithi139.stdout:(8/121): ceph-radosgw-15.1.0-567.g7df2194.el8.x 7.8 MB/s | 9.7 MB 00:01 2020-02-12T14:10:10.941 INFO:teuthology.orchestra.run.smithi139.stdout:(9/121): ceph-osd-15.1.0-567.g7df2194.el8.x86_6 7.9 MB/s | 17 MB 00:02 2020-02-12T14:10:15.318 INFO:teuthology.orchestra.run.smithi072.stdout:(10/121): ceph-selinux-15.1.0-567.g7df2194.el8. 3.6 kB/s | 25 kB 00:06 2020-02-12T14:10:15.375 INFO:teuthology.orchestra.run.smithi072.stdout:(11/121): cephadm-15.1.0-567.g7df2194.el8.x86_6 567 kB/s | 32 kB 00:00 2020-02-12T14:10:15.397 INFO:teuthology.orchestra.run.smithi072.stdout:(12/121): libcephfs-devel-15.1.0-567.g7df2194.e 959 kB/s | 21 kB 00:00 2020-02-12T14:10:15.459 INFO:teuthology.orchestra.run.smithi139.stdout:(10/121): ceph-common-15.1.0-567.g7df2194.el8.x 2.5 MB/s | 21 MB 00:08 2020-02-12T14:10:15.459 INFO:teuthology.orchestra.run.smithi139.stdout:(11/121): ceph-selinux-15.1.0-567.g7df2194.el8. 5.2 kB/s | 25 kB 00:04 2020-02-12T14:10:15.507 INFO:teuthology.orchestra.run.smithi139.stdout:(12/121): libcephfs-devel-15.1.0-567.g7df2194.e 450 kB/s | 21 kB 00:00 2020-02-12T14:10:15.524 INFO:teuthology.orchestra.run.smithi072.stdout:(13/121): libcephfs2-15.1.0-567.g7df2194.el8.x8 3.9 MB/s | 507 kB 00:00 2020-02-12T14:10:15.559 INFO:teuthology.orchestra.run.smithi139.stdout:(13/121): cephadm-15.1.0-567.g7df2194.el8.x86_6 324 kB/s | 32 kB 00:00 2020-02-12T14:10:15.607 INFO:teuthology.orchestra.run.smithi072.stdout:(14/121): librados-devel-15.1.0-567.g7df2194.el 1.7 MB/s | 141 kB 00:00 2020-02-12T14:10:15.658 INFO:teuthology.orchestra.run.smithi139.stdout:(14/121): librados-devel-15.1.0-567.g7df2194.el 1.4 MB/s | 141 kB 00:00 2020-02-12T14:10:15.682 INFO:teuthology.orchestra.run.smithi072.stdout:(15/121): libradosstriper1-15.1.0-567.g7df2194. 5.0 MB/s | 377 kB 00:00 2020-02-12T14:10:15.735 INFO:teuthology.orchestra.run.smithi072.stdout:(16/121): ceph-radosgw-15.1.0-567.g7df2194.el8. 1.1 MB/s | 9.7 MB 00:08 2020-02-12T14:10:15.780 INFO:teuthology.orchestra.run.smithi139.stdout:(15/121): libcephfs2-15.1.0-567.g7df2194.el8.x8 1.8 MB/s | 507 kB 00:00 2020-02-12T14:10:15.800 INFO:teuthology.orchestra.run.smithi072.stdout:(17/121): python3-ceph-argparse-15.1.0-567.g7df 618 kB/s | 40 kB 00:00 2020-02-12T14:10:15.838 INFO:teuthology.orchestra.run.smithi139.stdout:(16/121): libradosstriper1-15.1.0-567.g7df2194. 2.0 MB/s | 377 kB 00:00 2020-02-12T14:10:15.863 INFO:teuthology.orchestra.run.smithi072.stdout:(18/121): python3-ceph-common-15.1.0-567.g7df21 808 kB/s | 51 kB 00:00 2020-02-12T14:10:15.901 INFO:teuthology.orchestra.run.smithi139.stdout:(17/121): python3-ceph-argparse-15.1.0-567.g7df 629 kB/s | 40 kB 00:00 2020-02-12T14:10:15.933 INFO:teuthology.orchestra.run.smithi072.stdout:(19/121): python3-cephfs-15.1.0-567.g7df2194.el 2.1 MB/s | 149 kB 00:00 2020-02-12T14:10:15.968 INFO:teuthology.orchestra.run.smithi139.stdout:(18/121): python3-ceph-common-15.1.0-567.g7df21 759 kB/s | 51 kB 00:00 2020-02-12T14:10:16.014 INFO:teuthology.orchestra.run.smithi072.stdout:(20/121): python3-rados-15.1.0-567.g7df2194.el8 4.3 MB/s | 351 kB 00:00 2020-02-12T14:10:16.047 INFO:teuthology.orchestra.run.smithi139.stdout:(19/121): python3-cephfs-15.1.0-567.g7df2194.el 1.9 MB/s | 149 kB 00:00 2020-02-12T14:10:16.095 INFO:teuthology.orchestra.run.smithi072.stdout:(21/121): python3-rbd-15.1.0-567.g7df2194.el8.x 3.7 MB/s | 309 kB 00:00 2020-02-12T14:10:16.170 INFO:teuthology.orchestra.run.smithi072.stdout:(22/121): python3-rgw-15.1.0-567.g7df2194.el8.x 1.5 MB/s | 113 kB 00:00 2020-02-12T14:10:16.197 INFO:teuthology.orchestra.run.smithi139.stdout:(20/121): python3-rados-15.1.0-567.g7df2194.el8 2.3 MB/s | 351 kB 00:00 2020-02-12T14:10:16.246 INFO:teuthology.orchestra.run.smithi072.stdout:(23/121): rbd-fuse-15.1.0-567.g7df2194.el8.x86_ 941 kB/s | 72 kB 00:00 2020-02-12T14:10:16.381 INFO:teuthology.orchestra.run.smithi072.stdout:(24/121): librgw2-15.1.0-567.g7df2194.el8.x86_6 8.9 MB/s | 6.2 MB 00:00 2020-02-12T14:10:16.408 INFO:teuthology.orchestra.run.smithi139.stdout:(21/121): python3-rbd-15.1.0-567.g7df2194.el8.x 1.4 MB/s | 309 kB 00:00 2020-02-12T14:10:16.435 INFO:teuthology.orchestra.run.smithi072.stdout:(25/121): rbd-nbd-15.1.0-567.g7df2194.el8.x86_6 2.5 MB/s | 141 kB 00:00 2020-02-12T14:10:16.462 INFO:teuthology.orchestra.run.smithi139.stdout:(22/121): python3-rgw-15.1.0-567.g7df2194.el8.x 2.1 MB/s | 113 kB 00:00 2020-02-12T14:10:16.487 INFO:teuthology.orchestra.run.smithi072.stdout:(26/121): ceph-grafana-dashboards-15.1.0-567.g7 438 kB/s | 22 kB 00:00 2020-02-12T14:10:16.503 INFO:teuthology.orchestra.run.smithi139.stdout:(23/121): rbd-fuse-15.1.0-567.g7df2194.el8.x86_ 1.7 MB/s | 72 kB 00:00 2020-02-12T14:10:16.532 INFO:teuthology.orchestra.run.smithi072.stdout:(27/121): ceph-mgr-cephadm-15.1.0-567.g7df2194. 645 kB/s | 29 kB 00:00 2020-02-12T14:10:16.834 INFO:teuthology.orchestra.run.smithi072.stdout:(28/121): rbd-mirror-15.1.0-567.g7df2194.el8.x8 4.4 MB/s | 2.6 MB 00:00 2020-02-12T14:10:16.922 INFO:teuthology.orchestra.run.smithi072.stdout:(29/121): ceph-mgr-dashboard-15.1.0-567.g7df219 9.8 MB/s | 3.8 MB 00:00 2020-02-12T14:10:16.969 INFO:teuthology.orchestra.run.smithi072.stdout:(30/121): ceph-mgr-rook-15.1.0-567.g7df2194.el8 362 kB/s | 17 kB 00:00 2020-02-12T14:10:17.453 INFO:teuthology.orchestra.run.smithi139.stdout:(24/121): rbd-mirror-15.1.0-567.g7df2194.el8.x8 2.7 MB/s | 2.6 MB 00:00 2020-02-12T14:10:17.501 INFO:teuthology.orchestra.run.smithi139.stdout:(25/121): rbd-nbd-15.1.0-567.g7df2194.el8.x86_6 2.9 MB/s | 141 kB 00:00 2020-02-12T14:10:17.544 INFO:teuthology.orchestra.run.smithi139.stdout:(26/121): ceph-grafana-dashboards-15.1.0-567.g7 531 kB/s | 22 kB 00:00 2020-02-12T14:10:17.586 INFO:teuthology.orchestra.run.smithi139.stdout:(27/121): ceph-mgr-cephadm-15.1.0-567.g7df2194. 691 kB/s | 29 kB 00:00 2020-02-12T14:10:17.590 INFO:teuthology.orchestra.run.smithi072.stdout:(31/121): automake-1.16.1-6.el8.noarch.rpm 1.1 MB/s | 713 kB 00:00 2020-02-12T14:10:17.736 INFO:teuthology.orchestra.run.smithi139.stdout:(28/121): librgw2-15.1.0-567.g7df2194.el8.x86_6 3.2 MB/s | 6.2 MB 00:01 2020-02-12T14:10:17.801 INFO:teuthology.orchestra.run.smithi072.stdout:(32/121): bison-3.0.4-10.el8.x86_64.rpm 3.2 MB/s | 688 kB 00:00 2020-02-12T14:10:17.940 INFO:teuthology.orchestra.run.smithi072.stdout:(33/121): flex-2.6.1-9.el8.x86_64.rpm 2.2 MB/s | 320 kB 00:00 2020-02-12T14:10:18.015 INFO:teuthology.orchestra.run.smithi072.stdout:(34/121): jq-1.5-12.el8.x86_64.rpm 2.1 MB/s | 161 kB 00:00 2020-02-12T14:10:18.155 INFO:teuthology.orchestra.run.smithi072.stdout:(35/121): librdkafka-0.11.4-1.el8.x86_64.rpm 2.5 MB/s | 353 kB 00:00 2020-02-12T14:10:18.290 INFO:teuthology.orchestra.run.smithi072.stdout:(36/121): ceph-mgr-diskprediction-local-15.1.0- 5.9 MB/s | 8.6 MB 00:01 2020-02-12T14:10:18.365 INFO:teuthology.orchestra.run.smithi072.stdout:(37/121): libtool-2.4.6-25.el8.x86_64.rpm 3.3 MB/s | 709 kB 00:00 2020-02-12T14:10:18.437 INFO:teuthology.orchestra.run.smithi072.stdout:(38/121): oniguruma-6.8.2-1.el8.x86_64.rpm 2.6 MB/s | 188 kB 00:00 2020-02-12T14:10:18.652 INFO:teuthology.orchestra.run.smithi139.stdout:(29/121): ceph-mgr-dashboard-15.1.0-567.g7df219 3.6 MB/s | 3.8 MB 00:01 2020-02-12T14:10:18.689 INFO:teuthology.orchestra.run.smithi139.stdout:(30/121): ceph-mgr-rook-15.1.0-567.g7df2194.el8 461 kB/s | 17 kB 00:00 2020-02-12T14:10:18.774 INFO:teuthology.orchestra.run.smithi072.stdout:(39/121): lttng-ust-2.8.1-11.el8.x86_64.rpm 537 kB/s | 259 kB 00:00 2020-02-12T14:10:19.140 INFO:teuthology.orchestra.run.smithi072.stdout:(40/121): ceph-test-15.1.0-567.g7df2194.el8.x86 3.9 MB/s | 41 MB 00:10 2020-02-12T14:10:19.236 INFO:teuthology.orchestra.run.smithi139.stdout:(31/121): ceph-mgr-diskprediction-local-15.1.0- 5.7 MB/s | 8.6 MB 00:01 2020-02-12T14:10:19.268 INFO:teuthology.orchestra.run.smithi139.stdout:(32/121): automake-1.16.1-6.el8.noarch.rpm 1.2 MB/s | 713 kB 00:00 2020-02-12T14:10:19.414 INFO:teuthology.orchestra.run.smithi139.stdout:(33/121): flex-2.6.1-9.el8.x86_64.rpm 2.1 MB/s | 320 kB 00:00 2020-02-12T14:10:19.488 INFO:teuthology.orchestra.run.smithi139.stdout:(34/121): jq-1.5-12.el8.x86_64.rpm 2.1 MB/s | 161 kB 00:00 2020-02-12T14:10:19.559 INFO:teuthology.orchestra.run.smithi072.stdout:(41/121): python3-html5lib-0.999999999-6.el8.no 511 kB/s | 214 kB 00:00 2020-02-12T14:10:19.635 INFO:teuthology.orchestra.run.smithi139.stdout:(35/121): librdkafka-0.11.4-1.el8.x86_64.rpm 2.4 MB/s | 353 kB 00:00 2020-02-12T14:10:19.666 INFO:teuthology.orchestra.run.smithi072.stdout:(42/121): openblas-0.3.3-2.el8.x86_64.rpm 3.5 MB/s | 4.3 MB 00:01 2020-02-12T14:10:19.738 INFO:teuthology.orchestra.run.smithi072.stdout:(43/121): python3-mako-1.0.6-13.el8.noarch.rpm 2.1 MB/s | 157 kB 00:00 2020-02-12T14:10:19.808 INFO:teuthology.orchestra.run.smithi072.stdout:(44/121): python3-markupsafe-0.23-19.el8.x86_64 551 kB/s | 39 kB 00:00 2020-02-12T14:10:19.854 INFO:teuthology.orchestra.run.smithi139.stdout:(36/121): libtool-2.4.6-25.el8.x86_64.rpm 3.2 MB/s | 709 kB 00:00 2020-02-12T14:10:19.859 INFO:teuthology.orchestra.run.smithi139.stdout:(37/121): bison-3.0.4-10.el8.x86_64.rpm 1.1 MB/s | 688 kB 00:00 2020-02-12T14:10:19.929 INFO:teuthology.orchestra.run.smithi139.stdout:(38/121): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.4 MB/s | 259 kB 00:00 2020-02-12T14:10:19.931 INFO:teuthology.orchestra.run.smithi139.stdout:(39/121): oniguruma-6.8.2-1.el8.x86_64.rpm 2.6 MB/s | 188 kB 00:00 2020-02-12T14:10:20.049 INFO:teuthology.orchestra.run.smithi072.stdout:(45/121): python3-lxml-4.2.3-1.el8.x86_64.rpm 3.1 MB/s | 1.5 MB 00:00 2020-02-12T14:10:20.114 INFO:teuthology.orchestra.run.smithi072.stdout:(46/121): openblas-threads-0.3.3-2.el8.x86_64.r 3.3 MB/s | 4.4 MB 00:01 2020-02-12T14:10:20.122 INFO:teuthology.orchestra.run.smithi072.stdout:(47/121): python3-numpy-f2py-1.14.3-9.el8.x86_6 3.0 MB/s | 225 kB 00:00 2020-02-12T14:10:20.184 INFO:teuthology.orchestra.run.smithi072.stdout:(48/121): python3-prettytable-0.7.2-14.el8.noar 625 kB/s | 44 kB 00:00 2020-02-12T14:10:20.194 INFO:teuthology.orchestra.run.smithi072.stdout:(49/121): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.7 MB/s | 126 kB 00:00 2020-02-12T14:10:20.256 INFO:teuthology.orchestra.run.smithi072.stdout:(50/121): python3-pyasn1-modules-0.3.7-6.el8.no 1.5 MB/s | 110 kB 00:00 2020-02-12T14:10:20.265 INFO:teuthology.orchestra.run.smithi072.stdout:(51/121): python3-pytz-2017.2-9.el8.noarch.rpm 762 kB/s | 54 kB 00:00 2020-02-12T14:10:20.336 INFO:teuthology.orchestra.run.smithi072.stdout:(52/121): python3-webencodings-0.5.1-6.el8.noar 381 kB/s | 27 kB 00:00 2020-02-12T14:10:20.478 INFO:teuthology.orchestra.run.smithi072.stdout:(53/121): python3-werkzeug-0.12.2-4.el8.noarch. 3.1 MB/s | 457 kB 00:00 2020-02-12T14:10:20.619 INFO:teuthology.orchestra.run.smithi072.stdout:(54/121): socat-1.7.3.2-6.el8.x86_64.rpm 2.1 MB/s | 298 kB 00:00 2020-02-12T14:10:20.685 INFO:teuthology.orchestra.run.smithi072.stdout:(55/121): elfutils-libelf-devel-0.176-5.el8.x86 823 kB/s | 54 kB 00:00 2020-02-12T14:10:20.716 INFO:teuthology.orchestra.run.smithi072.stdout:(56/121): python3-numpy-1.14.3-9.el8.x86_64.rpm 4.1 MB/s | 3.7 MB 00:00 2020-02-12T14:10:20.716 INFO:teuthology.orchestra.run.smithi072.stdout:(57/121): fuse-2.9.7-12.el8.x86_64.rpm 2.6 MB/s | 82 kB 00:00 2020-02-12T14:10:20.730 INFO:teuthology.orchestra.run.smithi072.stdout:(58/121): fuse-common-3.2.1-12.el8.x86_64.rpm 1.5 MB/s | 21 kB 00:00 2020-02-12T14:10:20.795 INFO:teuthology.orchestra.run.smithi072.stdout:(59/121): keyutils-libs-devel-1.5.10-6.el8.x86_ 612 kB/s | 48 kB 00:00 2020-02-12T14:10:20.813 INFO:teuthology.orchestra.run.smithi072.stdout:(60/121): krb5-devel-1.17-9.el8.x86_64.rpm 6.5 MB/s | 548 kB 00:00 2020-02-12T14:10:20.817 INFO:teuthology.orchestra.run.smithi072.stdout:(61/121): libaio-devel-0.3.112-1.el8.x86_64.rpm 842 kB/s | 19 kB 00:00 2020-02-12T14:10:20.837 INFO:teuthology.orchestra.run.smithi072.stdout:(62/121): libcom_err-devel-1.44.6-3.el8.x86_64. 1.5 MB/s | 38 kB 00:00 2020-02-12T14:10:20.866 INFO:teuthology.orchestra.run.smithi072.stdout:(63/121): libquadmath-8.3.1-4.5.el8.x86_64.rpm 5.7 MB/s | 169 kB 00:00 2020-02-12T14:10:20.881 INFO:teuthology.orchestra.run.smithi072.stdout:(64/121): librabbitmq-0.9.0-1.el8.x86_64.rpm 3.2 MB/s | 47 kB 00:00 2020-02-12T14:10:20.890 INFO:teuthology.orchestra.run.smithi072.stdout:(65/121): libgfortran-8.3.1-4.5.el8.x86_64.rpm 8.6 MB/s | 638 kB 00:00 2020-02-12T14:10:20.912 INFO:teuthology.orchestra.run.smithi072.stdout:(66/121): libsepol-devel-2.9-1.el8.x86_64.rpm 3.9 MB/s | 86 kB 00:00 2020-02-12T14:10:20.916 INFO:teuthology.orchestra.run.smithi072.stdout:(67/121): libselinux-devel-2.9-2.1.el8.x86_64.r 5.5 MB/s | 199 kB 00:00 2020-02-12T14:10:20.934 INFO:teuthology.orchestra.run.smithi072.stdout:(68/121): libuuid-devel-2.32.1-17.el8.x86_64.rp 4.2 MB/s | 95 kB 00:00 2020-02-12T14:10:20.934 INFO:teuthology.orchestra.run.smithi072.stdout:(69/121): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.0 MB/s | 18 kB 00:00 2020-02-12T14:10:20.982 INFO:teuthology.orchestra.run.smithi072.stdout:(70/121): libxslt-1.1.32-3.el8.x86_64.rpm 5.1 MB/s | 249 kB 00:00 2020-02-12T14:10:21.048 INFO:teuthology.orchestra.run.smithi139.stdout:(40/121): openblas-threads-0.3.3-2.el8.x86_64.r 3.9 MB/s | 4.4 MB 00:01 2020-02-12T14:10:21.091 INFO:teuthology.orchestra.run.smithi139.stdout:(41/121): openblas-0.3.3-2.el8.x86_64.rpm 3.7 MB/s | 4.3 MB 00:01 2020-02-12T14:10:21.093 INFO:teuthology.orchestra.run.smithi072.stdout:(71/121): pcre2-devel-10.32-1.el8.x86_64.rpm 5.3 MB/s | 605 kB 00:00 2020-02-12T14:10:21.120 INFO:teuthology.orchestra.run.smithi139.stdout:(42/121): python3-html5lib-0.999999999-6.el8.no 2.9 MB/s | 214 kB 00:00 2020-02-12T14:10:21.152 INFO:teuthology.orchestra.run.smithi072.stdout:(72/121): pcre2-utf16-10.32-1.el8.x86_64.rpm 3.8 MB/s | 228 kB 00:00 2020-02-12T14:10:21.188 INFO:teuthology.orchestra.run.smithi072.stdout:(73/121): pcre2-utf32-10.32-1.el8.x86_64.rpm 6.0 MB/s | 220 kB 00:00 2020-02-12T14:10:21.229 INFO:teuthology.orchestra.run.smithi072.stdout:(74/121): python3-chardet-3.0.4-7.el8.noarch.rp 6.6 MB/s | 195 kB 00:00 2020-02-12T14:10:21.231 INFO:teuthology.orchestra.run.smithi072.stdout:(75/121): python3-jwt-1.6.1-2.el8.noarch.rpm 2.9 MB/s | 43 kB 00:00 2020-02-12T14:10:21.267 INFO:teuthology.orchestra.run.smithi072.stdout:(76/121): openssl-devel-1.1.1c-2.el8.x86_64.rpm 6.9 MB/s | 2.3 MB 00:00 2020-02-12T14:10:21.268 INFO:teuthology.orchestra.run.smithi072.stdout:(77/121): python3-oauthlib-2.1.0-1.el8.noarch.r 4.4 MB/s | 155 kB 00:00 2020-02-12T14:10:21.280 INFO:teuthology.orchestra.run.smithi072.stdout:(78/121): python3-pysocks-1.6.8-3.el8.noarch.rp 2.3 MB/s | 34 kB 00:00 2020-02-12T14:10:21.281 INFO:teuthology.orchestra.run.smithi072.stdout:(79/121): python3-requests-2.20.0-2.1.el8_1.noa 8.1 MB/s | 123 kB 00:00 2020-02-12T14:10:21.295 INFO:teuthology.orchestra.run.smithi072.stdout:(80/121): python3-requests-oauthlib-1.0.0-1.el8 2.9 MB/s | 43 kB 00:00 2020-02-12T14:10:21.310 INFO:teuthology.orchestra.run.smithi072.stdout:(81/121): python3-urllib3-1.24.2-2.el8.noarch.r 5.9 MB/s | 176 kB 00:00 2020-02-12T14:10:21.310 INFO:teuthology.orchestra.run.smithi072.stdout:(82/121): xfsprogs-devel-5.0.0-1.el8.x86_64.rpm 4.2 MB/s | 69 kB 00:00 2020-02-12T14:10:21.332 INFO:teuthology.orchestra.run.smithi072.stdout:(83/121): zlib-devel-1.2.11-10.el8.x86_64.rpm 2.5 MB/s | 56 kB 00:00 2020-02-12T14:10:21.370 INFO:teuthology.orchestra.run.smithi072.stdout:(84/121): python3-cheroot-8.2.1-1.el8.noarch.rp 2.4 MB/s | 145 kB 00:00 2020-02-12T14:10:21.396 INFO:teuthology.orchestra.run.smithi072.stdout:(85/121): python3-execnet-1.7.1-1.el8.2.noarch. 14 MB/s | 356 kB 00:00 2020-02-12T14:10:21.398 INFO:teuthology.orchestra.run.smithi072.stdout:(86/121): python3-cherrypy-18.4.0-1.el8.noarch. 5.7 MB/s | 385 kB 00:00 2020-02-12T14:10:21.404 INFO:teuthology.orchestra.run.smithi072.stdout:(87/121): python3-jaraco-6.2-6.el8.noarch.rpm 1.3 MB/s | 11 kB 00:00 2020-02-12T14:10:21.410 INFO:teuthology.orchestra.run.smithi072.stdout:(88/121): python3-jaraco-functools-2.0-4.el8.no 2.1 MB/s | 18 kB 00:00 2020-02-12T14:10:21.413 INFO:teuthology.orchestra.run.smithi072.stdout:(89/121): python3-logutils-0.3.5-11.el8.noarch. 5.5 MB/s | 49 kB 00:00 2020-02-12T14:10:21.415 INFO:teuthology.orchestra.run.smithi072.stdout:(90/121): python3-more-itertools-7.2.0-3.el8.no 6.9 MB/s | 59 kB 00:00 2020-02-12T14:10:21.424 INFO:teuthology.orchestra.run.smithi072.stdout:(91/121): python3-portend-2.6-1.el8.noarch.rpm 1.9 MB/s | 16 kB 00:00 2020-02-12T14:10:21.426 INFO:teuthology.orchestra.run.smithi072.stdout:(92/121): python3-pecan-1.3.2-9.el8.noarch.rpm 22 MB/s | 283 kB 00:00 2020-02-12T14:10:21.434 INFO:teuthology.orchestra.run.smithi072.stdout:(93/121): python3-repoze-lru-0.7-6.el8.noarch.r 3.9 MB/s | 34 kB 00:00 2020-02-12T14:10:21.435 INFO:teuthology.orchestra.run.smithi072.stdout:(94/121): python3-remoto-1.1.4-4.el8.noarch.rpm 4.3 MB/s | 48 kB 00:00 2020-02-12T14:10:21.443 INFO:teuthology.orchestra.run.smithi072.stdout:(95/121): python3-simplegeneric-0.8.1-17.el8.no 2.3 MB/s | 19 kB 00:00 2020-02-12T14:10:21.447 INFO:teuthology.orchestra.run.smithi072.stdout:(96/121): python3-routes-2.4.1-12.el8.noarch.rp 15 MB/s | 197 kB 00:00 2020-02-12T14:10:21.451 INFO:teuthology.orchestra.run.smithi072.stdout:(97/121): python3-singledispatch-3.4.0.3-18.el8 2.8 MB/s | 24 kB 00:00 2020-02-12T14:10:21.456 INFO:teuthology.orchestra.run.smithi072.stdout:(98/121): python3-tempora-1.14.1-5.el8.noarch.r 3.5 MB/s | 30 kB 00:00 2020-02-12T14:10:21.460 INFO:teuthology.orchestra.run.smithi072.stdout:(99/121): python3-trustme-0.5.2-4.el8.noarch.rp 3.1 MB/s | 27 kB 00:00 2020-02-12T14:10:21.461 INFO:teuthology.orchestra.run.smithi139.stdout:(43/121): ceph-test-15.1.0-567.g7df2194.el8.x86 3.9 MB/s | 41 MB 00:10 2020-02-12T14:10:21.463 INFO:teuthology.orchestra.run.smithi139.stdout:(44/121): python3-mako-1.0.6-13.el8.noarch.rpm 458 kB/s | 157 kB 00:00 2020-02-12T14:10:21.464 INFO:teuthology.orchestra.run.smithi072.stdout:(100/121): python3-zc-lockfile-2.0-2.el8.noarch 2.8 MB/s | 23 kB 00:00 2020-02-12T14:10:21.539 INFO:teuthology.orchestra.run.smithi072.stdout:(101/121): liboath-2.6.2-3.el8.x86_64.rpm 788 kB/s | 59 kB 00:00 2020-02-12T14:10:21.554 INFO:teuthology.orchestra.run.smithi072.stdout:(102/121): gperftools-libs-2.7-6.el8.x86_64.rpm 3.3 MB/s | 315 kB 00:00 2020-02-12T14:10:21.577 INFO:teuthology.orchestra.run.smithi072.stdout:(103/121): libunwind-1.3.1-3.el8.x86_64.rpm 2.0 MB/s | 75 kB 00:00 2020-02-12T14:10:21.592 INFO:teuthology.orchestra.run.smithi072.stdout:(104/121): python3-apipkg-1.5-6.el8.noarch.rpm 565 kB/s | 21 kB 00:00 2020-02-12T14:10:21.595 INFO:teuthology.orchestra.run.smithi072.stdout:(105/121): python3-bcrypt-3.1.6-2.el8.1.x86_64. 2.2 MB/s | 44 kB 00:00 2020-02-12T14:10:21.610 INFO:teuthology.orchestra.run.smithi139.stdout:(45/121): python3-lxml-4.2.3-1.el8.x86_64.rpm 2.9 MB/s | 1.5 MB 00:00 2020-02-12T14:10:21.623 INFO:teuthology.orchestra.run.smithi072.stdout:(106/121): python3-beautifulsoup4-4.6.3-2.el8.1 5.8 MB/s | 185 kB 00:00 2020-02-12T14:10:21.631 INFO:teuthology.orchestra.run.smithi072.stdout:(107/121): python3-cachetools-3.1.1-4.el8.noarc 929 kB/s | 33 kB 00:00 2020-02-12T14:10:21.639 INFO:teuthology.orchestra.run.smithi072.stdout:(108/121): python3-certifi-2018.10.15-7.el8.noa 1.0 MB/s | 16 kB 00:00 2020-02-12T14:10:21.650 INFO:teuthology.orchestra.run.smithi072.stdout:(109/121): python3-cssselect-0.9.2-10.el8.noarc 2.0 MB/s | 40 kB 00:00 2020-02-12T14:10:21.669 INFO:teuthology.orchestra.run.smithi072.stdout:(110/121): python3-google-auth-1.1.1-10.el8.noa 2.7 MB/s | 81 kB 00:00 2020-02-12T14:10:21.699 INFO:teuthology.orchestra.run.smithi072.stdout:(111/121): python3-rsa-3.4.2-12.el8.noarch.rpm 2.4 MB/s | 73 kB 00:00 2020-02-12T14:10:21.731 INFO:teuthology.orchestra.run.smithi072.stdout:(112/121): python3-waitress-1.2.1-2.el8.1.noarc 7.4 MB/s | 241 kB 00:00 2020-02-12T14:10:21.759 INFO:teuthology.orchestra.run.smithi139.stdout:(46/121): python3-markupsafe-0.23-19.el8.x86_64 130 kB/s | 39 kB 00:00 2020-02-12T14:10:21.763 INFO:teuthology.orchestra.run.smithi072.stdout:(113/121): python3-webob-1.8.5-1.el8.1.noarch.r 7.7 MB/s | 251 kB 00:00 2020-02-12T14:10:21.790 INFO:teuthology.orchestra.run.smithi072.stdout:(114/121): python3-websocket-client-0.56.0-5.el 2.2 MB/s | 61 kB 00:00 2020-02-12T14:10:21.806 INFO:teuthology.orchestra.run.smithi072.stdout:(115/121): python3-webtest-2.0.33-1.el8.noarch. 5.2 MB/s | 85 kB 00:00 2020-02-12T14:10:21.812 INFO:teuthology.orchestra.run.smithi072.stdout:(116/121): leveldb-1.21-2.el8.x86_64.rpm 29 MB/s | 179 kB 00:00 2020-02-12T14:10:21.814 INFO:teuthology.orchestra.run.smithi072.stdout:(117/121): xmlstarlet-1.6.1-13.el8.x86_64.rpm 59 MB/s | 69 kB 00:00 2020-02-12T14:10:21.857 INFO:teuthology.orchestra.run.smithi072.stdout:(118/121): python3-kubernetes-10.0.1-1.el8.noar 5.4 MB/s | 1.1 MB 00:00 2020-02-12T14:10:21.908 INFO:teuthology.orchestra.run.smithi139.stdout:(47/121): python3-prettytable-0.7.2-14.el8.noar 296 kB/s | 44 kB 00:00 2020-02-12T14:10:22.053 INFO:teuthology.orchestra.run.smithi072.stdout:(119/121): librbd1-15.1.0-567.g7df2194.el8.x86_ 9.5 MB/s | 1.9 MB 00:00 2020-02-12T14:10:22.057 INFO:teuthology.orchestra.run.smithi139.stdout:(48/121): python3-pyasn1-0.3.7-6.el8.noarch.rpm 848 kB/s | 126 kB 00:00 2020-02-12T14:10:22.133 INFO:teuthology.orchestra.run.smithi139.stdout:(49/121): python3-pyasn1-modules-0.3.7-6.el8.no 1.4 MB/s | 110 kB 00:00 2020-02-12T14:10:22.164 INFO:teuthology.orchestra.run.smithi072.stdout:(120/121): librados2-15.1.0-567.g7df2194.el8.x8 10 MB/s | 3.6 MB 00:00 2020-02-12T14:10:22.208 INFO:teuthology.orchestra.run.smithi139.stdout:(50/121): python3-pytz-2017.2-9.el8.noarch.rpm 721 kB/s | 54 kB 00:00 2020-02-12T14:10:22.258 INFO:teuthology.orchestra.run.smithi139.stdout:(51/121): python3-numpy-f2py-1.14.3-9.el8.x86_6 347 kB/s | 225 kB 00:00 2020-02-12T14:10:22.331 INFO:teuthology.orchestra.run.smithi139.stdout:(52/121): python3-webencodings-0.5.1-6.el8.noar 369 kB/s | 27 kB 00:00 2020-02-12T14:10:22.438 INFO:teuthology.orchestra.run.smithi139.stdout:(53/121): python3-numpy-1.14.3-9.el8.x86_64.rpm 3.8 MB/s | 3.7 MB 00:00 2020-02-12T14:10:22.578 INFO:teuthology.orchestra.run.smithi139.stdout:(54/121): socat-1.7.3.2-6.el8.x86_64.rpm 2.1 MB/s | 298 kB 00:00 2020-02-12T14:10:22.620 INFO:teuthology.orchestra.run.smithi139.stdout:(55/121): python3-werkzeug-0.12.2-4.el8.noarch. 1.5 MB/s | 457 kB 00:00 2020-02-12T14:10:22.627 INFO:teuthology.orchestra.run.smithi139.stdout:(56/121): elfutils-libelf-devel-0.176-5.el8.x86 1.1 MB/s | 54 kB 00:00 2020-02-12T14:10:22.639 INFO:teuthology.orchestra.run.smithi139.stdout:(57/121): fuse-common-3.2.1-12.el8.x86_64.rpm 1.7 MB/s | 21 kB 00:00 2020-02-12T14:10:22.651 INFO:teuthology.orchestra.run.smithi139.stdout:(58/121): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.8 MB/s | 48 kB 00:00 2020-02-12T14:10:22.677 INFO:teuthology.orchestra.run.smithi139.stdout:(59/121): fuse-2.9.7-12.el8.x86_64.rpm 1.4 MB/s | 82 kB 00:00 2020-02-12T14:10:22.692 INFO:teuthology.orchestra.run.smithi139.stdout:(60/121): libaio-devel-0.3.112-1.el8.x86_64.rpm 1.3 MB/s | 19 kB 00:00 2020-02-12T14:10:22.706 INFO:teuthology.orchestra.run.smithi139.stdout:(61/121): libcom_err-devel-1.44.6-3.el8.x86_64. 2.5 MB/s | 38 kB 00:00 2020-02-12T14:10:22.713 INFO:teuthology.orchestra.run.smithi139.stdout:(62/121): krb5-devel-1.17-9.el8.x86_64.rpm 8.8 MB/s | 548 kB 00:00 2020-02-12T14:10:22.737 INFO:teuthology.orchestra.run.smithi139.stdout:(63/121): libquadmath-8.3.1-4.5.el8.x86_64.rpm 6.8 MB/s | 169 kB 00:00 2020-02-12T14:10:22.750 INFO:teuthology.orchestra.run.smithi139.stdout:(64/121): librabbitmq-0.9.0-1.el8.x86_64.rpm 3.8 MB/s | 47 kB 00:00 2020-02-12T14:10:22.775 INFO:teuthology.orchestra.run.smithi139.stdout:(65/121): libselinux-devel-2.9-2.1.el8.x86_64.r 7.9 MB/s | 199 kB 00:00 2020-02-12T14:10:22.779 INFO:teuthology.orchestra.run.smithi139.stdout:(66/121): libgfortran-8.3.1-4.5.el8.x86_64.rpm 8.6 MB/s | 638 kB 00:00 2020-02-12T14:10:22.787 INFO:teuthology.orchestra.run.smithi139.stdout:(67/121): libsepol-devel-2.9-1.el8.x86_64.rpm 6.6 MB/s | 86 kB 00:00 2020-02-12T14:10:22.794 INFO:teuthology.orchestra.run.smithi139.stdout:(68/121): libuuid-devel-2.32.1-17.el8.x86_64.rp 6.2 MB/s | 95 kB 00:00 2020-02-12T14:10:22.800 INFO:teuthology.orchestra.run.smithi139.stdout:(69/121): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.4 MB/s | 18 kB 00:00 2020-02-12T14:10:22.824 INFO:teuthology.orchestra.run.smithi139.stdout:(70/121): libxslt-1.1.32-3.el8.x86_64.rpm 8.3 MB/s | 249 kB 00:00 2020-02-12T14:10:22.897 INFO:teuthology.orchestra.run.smithi139.stdout:(71/121): pcre2-devel-10.32-1.el8.x86_64.rpm 8.1 MB/s | 605 kB 00:00 2020-02-12T14:10:22.926 INFO:teuthology.orchestra.run.smithi139.stdout:(72/121): pcre2-utf16-10.32-1.el8.x86_64.rpm 7.6 MB/s | 228 kB 00:00 2020-02-12T14:10:22.958 INFO:teuthology.orchestra.run.smithi139.stdout:(73/121): pcre2-utf32-10.32-1.el8.x86_64.rpm 6.8 MB/s | 220 kB 00:00 2020-02-12T14:10:22.987 INFO:teuthology.orchestra.run.smithi139.stdout:(74/121): python3-chardet-3.0.4-7.el8.noarch.rp 6.6 MB/s | 195 kB 00:00 2020-02-12T14:10:23.002 INFO:teuthology.orchestra.run.smithi139.stdout:(75/121): python3-jwt-1.6.1-2.el8.noarch.rpm 2.8 MB/s | 43 kB 00:00 2020-02-12T14:10:23.031 INFO:teuthology.orchestra.run.smithi139.stdout:(76/121): python3-oauthlib-2.1.0-1.el8.noarch.r 5.3 MB/s | 155 kB 00:00 2020-02-12T14:10:23.046 INFO:teuthology.orchestra.run.smithi139.stdout:(77/121): python3-pysocks-1.6.8-3.el8.noarch.rp 2.3 MB/s | 34 kB 00:00 2020-02-12T14:10:23.061 INFO:teuthology.orchestra.run.smithi139.stdout:(78/121): python3-requests-2.20.0-2.1.el8_1.noa 8.1 MB/s | 123 kB 00:00 2020-02-12T14:10:23.079 INFO:teuthology.orchestra.run.smithi139.stdout:(79/121): openssl-devel-1.1.1c-2.el8.x86_64.rpm 8.2 MB/s | 2.3 MB 00:00 2020-02-12T14:10:23.080 INFO:teuthology.orchestra.run.smithi139.stdout:(80/121): python3-requests-oauthlib-1.0.0-1.el8 2.2 MB/s | 43 kB 00:00 2020-02-12T14:10:23.095 INFO:teuthology.orchestra.run.smithi139.stdout:(81/121): xfsprogs-devel-5.0.0-1.el8.x86_64.rpm 4.6 MB/s | 69 kB 00:00 2020-02-12T14:10:23.104 INFO:teuthology.orchestra.run.smithi139.stdout:(82/121): python3-urllib3-1.24.2-2.el8.noarch.r 7.0 MB/s | 176 kB 00:00 2020-02-12T14:10:23.110 INFO:teuthology.orchestra.run.smithi139.stdout:(83/121): zlib-devel-1.2.11-10.el8.x86_64.rpm 3.8 MB/s | 56 kB 00:00 2020-02-12T14:10:23.164 INFO:teuthology.orchestra.run.smithi139.stdout:(84/121): python3-cheroot-8.2.1-1.el8.noarch.rp 2.4 MB/s | 145 kB 00:00 2020-02-12T14:10:23.174 INFO:teuthology.orchestra.run.smithi139.stdout:(85/121): python3-cherrypy-18.4.0-1.el8.noarch. 5.8 MB/s | 385 kB 00:00 2020-02-12T14:10:23.183 INFO:teuthology.orchestra.run.smithi139.stdout:(86/121): python3-jaraco-6.2-6.el8.noarch.rpm 1.4 MB/s | 11 kB 00:00 2020-02-12T14:10:23.185 INFO:teuthology.orchestra.run.smithi139.stdout:(87/121): python3-execnet-1.7.1-1.el8.2.noarch. 17 MB/s | 356 kB 00:00 2020-02-12T14:10:23.191 INFO:teuthology.orchestra.run.smithi139.stdout:(88/121): python3-jaraco-functools-2.0-4.el8.no 2.1 MB/s | 18 kB 00:00 2020-02-12T14:10:23.196 INFO:teuthology.orchestra.run.smithi139.stdout:(89/121): python3-logutils-0.3.5-11.el8.noarch. 4.3 MB/s | 49 kB 00:00 2020-02-12T14:10:23.200 INFO:teuthology.orchestra.run.smithi139.stdout:(90/121): python3-more-itertools-7.2.0-3.el8.no 6.7 MB/s | 59 kB 00:00 2020-02-12T14:10:23.209 INFO:teuthology.orchestra.run.smithi139.stdout:(91/121): python3-portend-2.6-1.el8.noarch.rpm 1.8 MB/s | 16 kB 00:00 2020-02-12T14:10:23.214 INFO:teuthology.orchestra.run.smithi139.stdout:(92/121): python3-pecan-1.3.2-9.el8.noarch.rpm 15 MB/s | 283 kB 00:00 2020-02-12T14:10:23.219 INFO:teuthology.orchestra.run.smithi139.stdout:(93/121): python3-remoto-1.1.4-4.el8.noarch.rpm 4.9 MB/s | 48 kB 00:00 2020-02-12T14:10:23.223 INFO:teuthology.orchestra.run.smithi139.stdout:(94/121): python3-repoze-lru-0.7-6.el8.noarch.r 4.0 MB/s | 34 kB 00:00 2020-02-12T14:10:23.230 INFO:teuthology.orchestra.run.smithi139.stdout:(95/121): python3-routes-2.4.1-12.el8.noarch.rp 17 MB/s | 197 kB 00:00 2020-02-12T14:10:23.233 INFO:teuthology.orchestra.run.smithi139.stdout:(96/121): python3-simplegeneric-0.8.1-17.el8.no 1.8 MB/s | 19 kB 00:00 2020-02-12T14:10:23.239 INFO:teuthology.orchestra.run.smithi139.stdout:(97/121): python3-singledispatch-3.4.0.3-18.el8 2.8 MB/s | 24 kB 00:00 2020-02-12T14:10:23.242 INFO:teuthology.orchestra.run.smithi139.stdout:(98/121): python3-tempora-1.14.1-5.el8.noarch.r 3.5 MB/s | 30 kB 00:00 2020-02-12T14:10:23.248 INFO:teuthology.orchestra.run.smithi139.stdout:(99/121): python3-trustme-0.5.2-4.el8.noarch.rp 3.1 MB/s | 27 kB 00:00 2020-02-12T14:10:23.253 INFO:teuthology.orchestra.run.smithi139.stdout:(100/121): python3-zc-lockfile-2.0-2.el8.noarch 2.0 MB/s | 23 kB 00:00 2020-02-12T14:10:23.315 INFO:teuthology.orchestra.run.smithi139.stdout:(101/121): liboath-2.6.2-3.el8.x86_64.rpm 955 kB/s | 59 kB 00:00 2020-02-12T14:10:23.342 INFO:teuthology.orchestra.run.smithi139.stdout:(102/121): gperftools-libs-2.7-6.el8.x86_64.rpm 3.3 MB/s | 315 kB 00:00 2020-02-12T14:10:23.346 INFO:teuthology.orchestra.run.smithi139.stdout:(103/121): libunwind-1.3.1-3.el8.x86_64.rpm 2.4 MB/s | 75 kB 00:00 2020-02-12T14:10:23.358 INFO:teuthology.orchestra.run.smithi139.stdout:(104/121): python3-apipkg-1.5-6.el8.noarch.rpm 1.3 MB/s | 21 kB 00:00 2020-02-12T14:10:23.362 INFO:teuthology.orchestra.run.smithi139.stdout:(105/121): python3-bcrypt-3.1.6-2.el8.1.x86_64. 2.7 MB/s | 44 kB 00:00 2020-02-12T14:10:23.378 INFO:teuthology.orchestra.run.smithi139.stdout:(106/121): python3-cachetools-3.1.1-4.el8.noarc 2.0 MB/s | 33 kB 00:00 2020-02-12T14:10:23.391 INFO:teuthology.orchestra.run.smithi139.stdout:(107/121): python3-beautifulsoup4-4.6.3-2.el8.1 5.7 MB/s | 185 kB 00:00 2020-02-12T14:10:23.394 INFO:teuthology.orchestra.run.smithi139.stdout:(108/121): python3-certifi-2018.10.15-7.el8.noa 1.0 MB/s | 16 kB 00:00 2020-02-12T14:10:23.406 INFO:teuthology.orchestra.run.smithi139.stdout:(109/121): python3-cssselect-0.9.2-10.el8.noarc 2.5 MB/s | 40 kB 00:00 2020-02-12T14:10:23.410 INFO:teuthology.orchestra.run.smithi139.stdout:(110/121): python3-google-auth-1.1.1-10.el8.noa 4.9 MB/s | 81 kB 00:00 2020-02-12T14:10:23.426 INFO:teuthology.orchestra.run.smithi139.stdout:(111/121): python3-rsa-3.4.2-12.el8.noarch.rpm 4.4 MB/s | 73 kB 00:00 2020-02-12T14:10:23.458 INFO:teuthology.orchestra.run.smithi139.stdout:(112/121): python3-waitress-1.2.1-2.el8.1.noarc 7.4 MB/s | 241 kB 00:00 2020-02-12T14:10:23.490 INFO:teuthology.orchestra.run.smithi139.stdout:(113/121): python3-webob-1.8.5-1.el8.1.noarch.r 7.8 MB/s | 251 kB 00:00 2020-02-12T14:10:23.506 INFO:teuthology.orchestra.run.smithi139.stdout:(114/121): python3-websocket-client-0.56.0-5.el 3.7 MB/s | 61 kB 00:00 2020-02-12T14:10:23.522 INFO:teuthology.orchestra.run.smithi139.stdout:(115/121): python3-webtest-2.0.33-1.el8.noarch. 5.2 MB/s | 85 kB 00:00 2020-02-12T14:10:23.528 INFO:teuthology.orchestra.run.smithi139.stdout:(116/121): leveldb-1.21-2.el8.x86_64.rpm 30 MB/s | 179 kB 00:00 2020-02-12T14:10:23.530 INFO:teuthology.orchestra.run.smithi139.stdout:(117/121): xmlstarlet-1.6.1-13.el8.x86_64.rpm 49 MB/s | 69 kB 00:00 2020-02-12T14:10:23.545 INFO:teuthology.orchestra.run.smithi139.stdout:(118/121): python3-kubernetes-10.0.1-1.el8.noar 8.0 MB/s | 1.1 MB 00:00 2020-02-12T14:10:23.812 INFO:teuthology.orchestra.run.smithi139.stdout:(119/121): librbd1-15.1.0-567.g7df2194.el8.x86_ 7.0 MB/s | 1.9 MB 00:00 2020-02-12T14:10:23.820 INFO:teuthology.orchestra.run.smithi072.stdout:(121/121): python3-scipy-1.0.0-20.module_el8.1. 4.1 MB/s | 15 MB 00:03 2020-02-12T14:10:23.823 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2020-02-12T14:10:23.823 INFO:teuthology.orchestra.run.smithi072.stdout:Total 8.9 MB/s | 176 MB 00:19 2020-02-12T14:10:23.883 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2020-02-12T14:10:23.993 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2020-02-12T14:10:23.993 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2020-02-12T14:10:24.024 INFO:teuthology.orchestra.run.smithi139.stdout:(120/121): librados2-15.1.0-567.g7df2194.el8.x8 7.2 MB/s | 3.6 MB 00:00 2020-02-12T14:10:25.320 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2020-02-12T14:10:25.321 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2020-02-12T14:10:26.147 INFO:teuthology.orchestra.run.smithi139.stdout:(121/121): python3-scipy-1.0.0-20.module_el8.1. 3.7 MB/s | 15 MB 00:03 2020-02-12T14:10:26.151 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2020-02-12T14:10:26.151 INFO:teuthology.orchestra.run.smithi139.stdout:Total 8.1 MB/s | 176 MB 00:21 2020-02-12T14:10:26.218 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2020-02-12T14:10:26.328 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2020-02-12T14:10:26.328 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2020-02-12T14:10:27.598 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2020-02-12T14:10:27.599 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2020-02-12T14:10:29.572 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2020-02-12T14:10:29.753 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/123 2020-02-12T14:10:29.973 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 2/123 2020-02-12T14:10:30.168 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/123 2020-02-12T14:10:30.556 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/123 2020-02-12T14:10:30.784 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librados2-2:15.1.0-567.g7df2194.el8.x86_64 4/123 2020-02-12T14:10:31.001 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:15.1.0-567.g7df2194.el8.x86_64 4/123 2020-02-12T14:10:31.209 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librbd1-2:15.1.0-567.g7df2194.el8.x86_64 5/123 2020-02-12T14:10:31.293 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:15.1.0-567.g7df2194.el8.x86_64 5/123 2020-02-12T14:10:31.434 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs2-2:15.1.0-567.g7df2194.el8.x86_64 6/123 2020-02-12T14:10:31.526 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephfs2-2:15.1.0-567.g7df2194.el8.x86_64 6/123 2020-02-12T14:10:31.726 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rados-2:15.1.0-567.g7df2194.el8.x86_64 7/123 2020-02-12T14:10:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2020-02-12T14:10:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/123 2020-02-12T14:10:32.056 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/123 2020-02-12T14:10:32.244 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 2/123 2020-02-12T14:10:32.459 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/123 2020-02-12T14:10:32.582 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/123 2020-02-12T14:10:32.726 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librgw2-2:15.1.0-567.g7df2194.el8.x86_64 9/123 2020-02-12T14:10:32.833 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librgw2-2:15.1.0-567.g7df2194.el8.x86_64 9/123 2020-02-12T14:10:32.851 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/123 2020-02-12T14:10:33.001 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librados2-2:15.1.0-567.g7df2194.el8.x86_64 4/123 2020-02-12T14:10:33.051 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/123 2020-02-12T14:10:33.192 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libradosstriper1-2:15.1.0-567.g7df2194.el8.x86_6 11/123 2020-02-12T14:10:33.234 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-2:15.1.0-567.g7df2194.el8.x86_64 4/123 2020-02-12T14:10:33.312 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libradosstriper1-2:15.1.0-567.g7df2194.el8.x86_6 11/123 2020-02-12T14:10:33.409 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librbd1-2:15.1.0-567.g7df2194.el8.x86_64 5/123 2020-02-12T14:10:33.509 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 12/123 2020-02-12T14:10:33.515 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-2:15.1.0-567.g7df2194.el8.x86_64 5/123 2020-02-12T14:10:33.642 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs2-2:15.1.0-567.g7df2194.el8.x86_64 6/123 2020-02-12T14:10:33.673 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/123 2020-02-12T14:10:33.722 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephfs2-2:15.1.0-567.g7df2194.el8.x86_64 6/123 2020-02-12T14:10:33.850 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 14/123 2020-02-12T14:10:33.883 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rados-2:15.1.0-567.g7df2194.el8.x86_64 7/123 2020-02-12T14:10:34.042 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 15/123 2020-02-12T14:10:34.075 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/123 2020-02-12T14:10:34.284 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 16/123 2020-02-12T14:10:34.434 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 17/123 2020-02-12T14:10:34.573 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 17/123 2020-02-12T14:10:34.677 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/123 2020-02-12T14:10:34.717 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 18/123 2020-02-12T14:10:35.202 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librgw2-2:15.1.0-567.g7df2194.el8.x86_64 9/123 2020-02-12T14:10:35.289 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 18/123 2020-02-12T14:10:35.308 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librgw2-2:15.1.0-567.g7df2194.el8.x86_64 9/123 2020-02-12T14:10:35.467 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-0.3.3-2.el8.x86_64 19/123 2020-02-12T14:10:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/123 2020-02-12T14:10:35.642 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libradosstriper1-2:15.1.0-567.g7df2194.el8.x86_6 11/123 2020-02-12T14:10:35.760 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libradosstriper1-2:15.1.0-567.g7df2194.el8.x86_6 11/123 2020-02-12T14:10:35.920 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 12/123 2020-02-12T14:10:35.993 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 19/123 2020-02-12T14:10:36.089 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/123 2020-02-12T14:10:36.158 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 20/123 2020-02-12T14:10:36.282 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 14/123 2020-02-12T14:10:36.475 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 15/123 2020-02-12T14:10:36.686 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 16/123 2020-02-12T14:10:36.825 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 17/123 2020-02-12T14:10:36.850 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 20/123 2020-02-12T14:10:36.945 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 17/123 2020-02-12T14:10:37.083 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 18/123 2020-02-12T14:10:37.159 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 21/123 2020-02-12T14:10:37.380 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/123 2020-02-12T14:10:37.541 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-argparse-2:15.1.0-567.g7df2194.el8. 23/123 2020-02-12T14:10:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 18/123 2020-02-12T14:10:37.767 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-0.3.3-2.el8.x86_64 19/123 2020-02-12T14:10:37.813 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cephfs-2:15.1.0-567.g7df2194.el8.x86_64 24/123 2020-02-12T14:10:38.067 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/123 2020-02-12T14:10:38.289 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 19/123 2020-02-12T14:10:38.450 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 20/123 2020-02-12T14:10:39.147 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 20/123 2020-02-12T14:10:39.475 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 21/123 2020-02-12T14:10:39.646 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/123 2020-02-12T14:10:39.816 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-argparse-2:15.1.0-567.g7df2194.el8. 23/123 2020-02-12T14:10:40.043 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/123 2020-02-12T14:10:40.079 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cephfs-2:15.1.0-567.g7df2194.el8.x86_64 24/123 2020-02-12T14:10:40.308 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/123 2020-02-12T14:10:40.485 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 26/123 2020-02-12T14:10:40.729 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xmlstarlet-1.6.1-13.el8.x86_64 27/123 2020-02-12T14:10:40.970 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 28/123 2020-02-12T14:10:41.172 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 29/123 2020-02-12T14:10:41.352 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 30/123 2020-02-12T14:10:41.544 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rgw-2:15.1.0-567.g7df2194.el8.x86_64 31/123 2020-02-12T14:10:41.739 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rbd-2:15.1.0-567.g7df2194.el8.x86_64 32/123 2020-02-12T14:10:41.977 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librados-devel-2:15.1.0-567.g7df2194.el8.x86_64 33/123 2020-02-12T14:10:42.238 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 34/123 2020-02-12T14:10:42.279 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/123 2020-02-12T14:10:42.418 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 35/123 2020-02-12T14:10:42.542 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 26/123 2020-02-12T14:10:42.623 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 36/123 2020-02-12T14:10:42.761 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : xmlstarlet-1.6.1-13.el8.x86_64 27/123 2020-02-12T14:10:42.788 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 37/123 2020-02-12T14:10:43.003 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 38/123 2020-02-12T14:10:43.011 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 28/123 2020-02-12T14:10:43.192 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 39/123 2020-02-12T14:10:43.238 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 29/123 2020-02-12T14:10:43.389 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 40/123 2020-02-12T14:10:43.410 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 30/123 2020-02-12T14:10:43.595 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rgw-2:15.1.0-567.g7df2194.el8.x86_64 31/123 2020-02-12T14:10:43.620 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 41/123 2020-02-12T14:10:43.771 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rbd-2:15.1.0-567.g7df2194.el8.x86_64 32/123 2020-02-12T14:10:43.861 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 42/123 2020-02-12T14:10:43.985 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librados-devel-2:15.1.0-567.g7df2194.el8.x86_64 33/123 2020-02-12T14:10:44.039 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 43/123 2020-02-12T14:10:44.236 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 34/123 2020-02-12T14:10:44.238 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 44/123 2020-02-12T14:10:44.426 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 35/123 2020-02-12T14:10:44.443 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 45/123 2020-02-12T14:10:44.589 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 36/123 2020-02-12T14:10:44.615 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : leveldb-1.21-2.el8.x86_64 46/123 2020-02-12T14:10:44.774 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 47/123 2020-02-12T14:10:44.788 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 37/123 2020-02-12T14:10:44.931 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 48/123 2020-02-12T14:10:45.003 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 38/123 2020-02-12T14:10:45.112 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 49/123 2020-02-12T14:10:45.166 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 39/123 2020-02-12T14:10:45.276 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 50/123 2020-02-12T14:10:45.372 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 40/123 2020-02-12T14:10:45.475 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 51/123 2020-02-12T14:10:45.609 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 41/123 2020-02-12T14:10:45.693 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 52/123 2020-02-12T14:10:45.843 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 42/123 2020-02-12T14:10:45.869 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 53/123 2020-02-12T14:10:46.005 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 54/123 2020-02-12T14:10:46.016 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 43/123 2020-02-12T14:10:46.192 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 44/123 2020-02-12T14:10:46.198 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 55/123 2020-02-12T14:10:46.340 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 45/123 2020-02-12T14:10:46.406 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 56/123 2020-02-12T14:10:46.540 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : leveldb-1.21-2.el8.x86_64 46/123 2020-02-12T14:10:46.602 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 57/123 2020-02-12T14:10:46.706 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 47/123 2020-02-12T14:10:46.824 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 58/123 2020-02-12T14:10:46.872 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 48/123 2020-02-12T14:10:47.028 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 49/123 2020-02-12T14:10:47.054 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 59/123 2020-02-12T14:10:47.175 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 50/123 2020-02-12T14:10:47.237 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 60/123 2020-02-12T14:10:47.383 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 51/123 2020-02-12T14:10:47.575 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 52/123 2020-02-12T14:10:47.717 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 53/123 2020-02-12T14:10:47.845 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 54/123 2020-02-12T14:10:48.034 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 55/123 2020-02-12T14:10:48.238 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 56/123 2020-02-12T14:10:48.265 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 61/123 2020-02-12T14:10:48.447 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 57/123 2020-02-12T14:10:48.476 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-kubernetes-10.0.1-1.el8.noarch 62/123 2020-02-12T14:10:48.652 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 63/123 2020-02-12T14:10:48.679 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 58/123 2020-02-12T14:10:48.860 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 59/123 2020-02-12T14:10:48.946 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 64/123 2020-02-12T14:10:49.086 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 60/123 2020-02-12T14:10:49.126 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 65/123 2020-02-12T14:10:49.255 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 66/123 2020-02-12T14:10:49.420 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 67/123 2020-02-12T14:10:49.704 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 68/123 2020-02-12T14:10:49.902 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 69/123 2020-02-12T14:10:50.052 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 70/123 2020-02-12T14:10:50.103 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 61/123 2020-02-12T14:10:50.271 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 71/123 2020-02-12T14:10:50.334 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-kubernetes-10.0.1-1.el8.noarch 62/123 2020-02-12T14:10:50.459 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 72/123 2020-02-12T14:10:50.460 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 73/123 2020-02-12T14:10:50.460 INFO:teuthology.orchestra.run.smithi072.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-02-12T14:10:50.460 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:10:50.516 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 63/123 2020-02-12T14:10:50.828 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 64/123 2020-02-12T14:10:50.883 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fuse-2.9.7-12.el8.x86_64 74/123 2020-02-12T14:10:51.008 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 65/123 2020-02-12T14:10:51.084 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 75/123 2020-02-12T14:10:51.155 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 66/123 2020-02-12T14:10:51.328 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 67/123 2020-02-12T14:10:51.343 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 76/123 2020-02-12T14:10:51.602 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 77/123 2020-02-12T14:10:51.640 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 68/123 2020-02-12T14:10:51.835 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 69/123 2020-02-12T14:10:51.968 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 70/123 2020-02-12T14:10:52.004 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 78/123 2020-02-12T14:10:52.159 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 71/123 2020-02-12T14:10:52.290 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 79/123 2020-02-12T14:10:52.384 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 72/123 2020-02-12T14:10:52.384 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 73/123 2020-02-12T14:10:52.384 INFO:teuthology.orchestra.run.smithi139.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-02-12T14:10:52.384 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:10:52.520 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/123 2020-02-12T14:10:52.726 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 81/123 2020-02-12T14:10:52.749 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : fuse-2.9.7-12.el8.x86_64 74/123 2020-02-12T14:10:52.920 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 82/123 2020-02-12T14:10:52.933 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 75/123 2020-02-12T14:10:53.172 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-portend-2.6-1.el8.noarch 83/123 2020-02-12T14:10:53.182 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 76/123 2020-02-12T14:10:53.418 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 77/123 2020-02-12T14:10:53.465 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/123 2020-02-12T14:10:53.619 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 85/123 2020-02-12T14:10:53.796 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 78/123 2020-02-12T14:10:53.851 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 86/123 2020-02-12T14:10:54.053 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 79/123 2020-02-12T14:10:54.210 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 87/123 2020-02-12T14:10:54.269 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/123 2020-02-12T14:10:54.450 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 81/123 2020-02-12T14:10:54.493 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 88/123 2020-02-12T14:10:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 82/123 2020-02-12T14:10:54.673 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 89/123 2020-02-12T14:10:54.755 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 89/123 2020-02-12T14:10:54.880 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-portend-2.6-1.el8.noarch 83/123 2020-02-12T14:10:55.017 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : jq-1.5-12.el8.x86_64 90/123 2020-02-12T14:10:55.147 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/123 2020-02-12T14:10:55.213 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : automake-1.16.1-6.el8.noarch 91/123 2020-02-12T14:10:55.302 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 85/123 2020-02-12T14:10:55.506 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-grafana-dashboards-2:15.1.0-567.g7df2194.el 92/123 2020-02-12T14:10:55.534 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 86/123 2020-02-12T14:10:55.682 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-common-2:15.1.0-567.g7df2194.el8.x8 93/123 2020-02-12T14:10:55.881 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 87/123 2020-02-12T14:10:56.158 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 88/123 2020-02-12T14:10:56.308 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 89/123 2020-02-12T14:10:56.403 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 89/123 2020-02-12T14:10:56.692 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : jq-1.5-12.el8.x86_64 90/123 2020-02-12T14:10:56.895 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : automake-1.16.1-6.el8.noarch 91/123 2020-02-12T14:10:57.104 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-grafana-dashboards-2:15.1.0-567.g7df2194.el 92/123 2020-02-12T14:10:57.314 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-common-2:15.1.0-567.g7df2194.el8.x8 93/123 2020-02-12T14:10:59.116 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:15.1.0-567.g7df2194.el8.x86_64 94/123 2020-02-12T14:10:59.347 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-common-2:15.1.0-567.g7df2194.el8.x86_64 94/123 2020-02-12T14:11:00.016 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:15.1.0-567.g7df2194.el8.x86_64 94/123 2020-02-12T14:11:00.281 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-base-2:15.1.0-567.g7df2194.el8.x86_64 95/123 2020-02-12T14:11:00.387 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-base-2:15.1.0-567.g7df2194.el8.x86_64 95/123 2020-02-12T14:11:00.688 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-selinux-2:15.1.0-567.g7df2194.el8.x86_64 96/123 2020-02-12T14:11:00.751 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:15.1.0-567.g7df2194.el8.x86_64 94/123 2020-02-12T14:11:01.021 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-common-2:15.1.0-567.g7df2194.el8.x86_64 94/123 2020-02-12T14:11:01.682 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:15.1.0-567.g7df2194.el8.x86_64 94/123 2020-02-12T14:11:01.904 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-base-2:15.1.0-567.g7df2194.el8.x86_64 95/123 2020-02-12T14:11:01.987 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-base-2:15.1.0-567.g7df2194.el8.x86_64 95/123 2020-02-12T14:11:02.121 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-selinux-2:15.1.0-567.g7df2194.el8.x86_64 96/123 2020-02-12T14:11:16.930 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-selinux-2:15.1.0-567.g7df2194.el8.x86_64 96/123 2020-02-12T14:11:16.931 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /sys 2020-02-12T14:11:16.931 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /proc 2020-02-12T14:11:16.931 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /dev 2020-02-12T14:11:16.931 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /run 2020-02-12T14:11:16.931 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /mnt 2020-02-12T14:11:16.931 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /var/tmp 2020-02-12T14:11:16.932 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /home 2020-02-12T14:11:16.932 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /tmp 2020-02-12T14:11:16.932 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /dev 2020-02-12T14:11:16.932 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:17.370 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-2:15.1.0-567.g7df2194.el8.x86_64 97/123 2020-02-12T14:11:17.565 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-2:15.1.0-567.g7df2194.el8.x86_64 97/123 2020-02-12T14:11:17.728 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mds-2:15.1.0-567.g7df2194.el8.x86_64 98/123 2020-02-12T14:11:18.108 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mds-2:15.1.0-567.g7df2194.el8.x86_64 98/123 2020-02-12T14:11:18.310 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mon-2:15.1.0-567.g7df2194.el8.x86_64 99/123 2020-02-12T14:11:18.457 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-selinux-2:15.1.0-567.g7df2194.el8.x86_64 96/123 2020-02-12T14:11:18.457 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /sys 2020-02-12T14:11:18.457 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /proc 2020-02-12T14:11:18.458 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /dev 2020-02-12T14:11:18.458 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /run 2020-02-12T14:11:18.458 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /mnt 2020-02-12T14:11:18.458 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /var/tmp 2020-02-12T14:11:18.458 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /home 2020-02-12T14:11:18.458 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /tmp 2020-02-12T14:11:18.458 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /dev 2020-02-12T14:11:18.459 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:18.901 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-2:15.1.0-567.g7df2194.el8.x86_64 97/123 2020-02-12T14:11:19.097 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-2:15.1.0-567.g7df2194.el8.x86_64 97/123 2020-02-12T14:11:19.260 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mds-2:15.1.0-567.g7df2194.el8.x86_64 98/123 2020-02-12T14:11:19.639 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mds-2:15.1.0-567.g7df2194.el8.x86_64 98/123 2020-02-12T14:11:19.720 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mon-2:15.1.0-567.g7df2194.el8.x86_64 99/123 2020-02-12T14:11:19.830 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mon-2:15.1.0-567.g7df2194.el8.x86_64 99/123 2020-02-12T14:11:19.953 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-osd-2:15.1.0-567.g7df2194.el8.x86_64 100/123 2020-02-12T14:11:19.976 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-osd-2:15.1.0-567.g7df2194.el8.x86_64 100/123 2020-02-12T14:11:21.237 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mon-2:15.1.0-567.g7df2194.el8.x86_64 99/123 2020-02-12T14:11:21.298 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephadm-2:15.1.0-567.g7df2194.el8.x86_64 101/123 2020-02-12T14:11:21.451 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-osd-2:15.1.0-567.g7df2194.el8.x86_64 100/123 2020-02-12T14:11:21.474 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephadm-2:15.1.0-567.g7df2194.el8.x86_64 101/123 2020-02-12T14:11:21.476 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-osd-2:15.1.0-567.g7df2194.el8.x86_64 100/123 2020-02-12T14:11:21.627 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-cephadm-2:15.1.0-567.g7df2194.el8.noarc 102/123 2020-02-12T14:11:21.642 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.1.0-567.g7df2194.el8.noarc 102/123 2020-02-12T14:11:22.594 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-2:15.1.0-567.g7df2194.el8.x86_64 103/123 2020-02-12T14:11:22.727 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephadm-2:15.1.0-567.g7df2194.el8.x86_64 101/123 2020-02-12T14:11:22.835 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-dashboard-2:15.1.0-567.g7df2194.el8.noa 104/123 2020-02-12T14:11:22.897 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephadm-2:15.1.0-567.g7df2194.el8.x86_64 101/123 2020-02-12T14:11:23.447 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-cephadm-2:15.1.0-567.g7df2194.el8.noarc 102/123 2020-02-12T14:11:23.465 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.1.0-567.g7df2194.el8.noarc 102/123 2020-02-12T14:11:23.875 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.1.0-567.g7df2194.el8.noa 104/123 2020-02-12T14:11:24.398 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-diskprediction-local-2:15.1.0-567.g7df2 105/123 2020-02-12T14:11:24.415 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.1.0-567.g7df2 105/123 2020-02-12T14:11:24.560 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-rook-2:15.1.0-567.g7df2194.el8.noarch 106/123 2020-02-12T14:11:24.721 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-2:15.1.0-567.g7df2194.el8.x86_64 103/123 2020-02-12T14:11:25.000 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-dashboard-2:15.1.0-567.g7df2194.el8.noa 104/123 2020-02-12T14:11:25.447 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-rook-2:15.1.0-567.g7df2194.el8.noarch 106/123 2020-02-12T14:11:25.669 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-radosgw-2:15.1.0-567.g7df2194.el8.x86_64 107/123 2020-02-12T14:11:25.967 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-radosgw-2:15.1.0-567.g7df2194.el8.x86_64 107/123 2020-02-12T14:11:26.039 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.1.0-567.g7df2194.el8.noa 104/123 2020-02-12T14:11:26.166 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-mirror-2:15.1.0-567.g7df2194.el8.x86_64 108/123 2020-02-12T14:11:26.225 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-diskprediction-local-2:15.1.0-567.g7df2 105/123 2020-02-12T14:11:26.241 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.1.0-567.g7df2 105/123 2020-02-12T14:11:26.408 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-rook-2:15.1.0-567.g7df2194.el8.noarch 106/123 2020-02-12T14:11:27.297 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-rook-2:15.1.0-567.g7df2194.el8.noarch 106/123 2020-02-12T14:11:27.491 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-radosgw-2:15.1.0-567.g7df2194.el8.x86_64 107/123 2020-02-12T14:11:27.792 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-radosgw-2:15.1.0-567.g7df2194.el8.x86_64 107/123 2020-02-12T14:11:28.041 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-mirror-2:15.1.0-567.g7df2194.el8.x86_64 108/123 2020-02-12T14:11:30.462 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: rbd-mirror-2:15.1.0-567.g7df2194.el8.x86_64 108/123 2020-02-12T14:11:31.377 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-test-2:15.1.0-567.g7df2194.el8.x86_64 109/123 2020-02-12T14:11:31.526 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libtool-2.4.6-25.el8.x86_64 110/123 2020-02-12T14:11:31.588 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 110/123 2020-02-12T14:11:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: rbd-mirror-2:15.1.0-567.g7df2194.el8.x86_64 108/123 2020-02-12T14:11:32.166 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-test-2:15.1.0-567.g7df2194.el8.x86_64 109/123 2020-02-12T14:11:32.324 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libtool-2.4.6-25.el8.x86_64 110/123 2020-02-12T14:11:32.383 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 110/123 2020-02-12T14:11:32.419 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-fuse-2:15.1.0-567.g7df2194.el8.x86_64 111/123 2020-02-12T14:11:32.678 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openssl-devel-1:1.1.1c-2.el8.x86_64 112/123 2020-02-12T14:11:32.812 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 113/123 2020-02-12T14:11:32.954 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs-devel-2:15.1.0-567.g7df2194.el8.x86_64 114/123 2020-02-12T14:11:33.091 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 115/123 2020-02-12T14:11:33.224 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-fuse-2:15.1.0-567.g7df2194.el8.x86_64 111/123 2020-02-12T14:11:33.297 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-fuse-2:15.1.0-567.g7df2194.el8.x86_64 116/123 2020-02-12T14:11:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openssl-devel-1:1.1.1c-2.el8.x86_64 112/123 2020-02-12T14:11:33.486 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-nbd-2:15.1.0-567.g7df2194.el8.x86_64 117/123 2020-02-12T14:11:33.618 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 113/123 2020-02-12T14:11:33.692 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-immutable-object-cache-2:15.1.0-567.g7df219 118/123 2020-02-12T14:11:33.715 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.1.0-567.g7df219 118/123 2020-02-12T14:11:33.759 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs-devel-2:15.1.0-567.g7df2194.el8.x86_64 114/123 2020-02-12T14:11:33.915 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 119/123 2020-02-12T14:11:33.939 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 115/123 2020-02-12T14:11:34.120 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-fuse-2:15.1.0-567.g7df2194.el8.x86_64 116/123 2020-02-12T14:11:34.159 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/123 2020-02-12T14:11:34.256 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/123 2020-02-12T14:11:34.284 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-nbd-2:15.1.0-567.g7df2194.el8.x86_64 117/123 2020-02-12T14:11:34.449 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-immutable-object-cache-2:15.1.0-567.g7df219 118/123 2020-02-12T14:11:34.450 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : bison-3.0.4-10.el8.x86_64 121/123 2020-02-12T14:11:34.464 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 121/123 2020-02-12T14:11:34.465 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 122/123 2020-02-12T14:11:34.473 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.1.0-567.g7df219 118/123 2020-02-12T14:11:34.651 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 119/123 2020-02-12T14:11:34.737 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 122/123 2020-02-12T14:11:34.737 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 123/123 2020-02-12T14:11:35.568 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 123/123 2020-02-12T14:11:35.568 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-2:15.1.0-567.g7df2194.el8.x86_64 1/123 2020-02-12T14:11:35.568 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-base-2:15.1.0-567.g7df2194.el8.x86_64 2/123 2020-02-12T14:11:35.568 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-common-2:15.1.0-567.g7df2194.el8.x86_64 3/123 2020-02-12T14:11:35.568 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-fuse-2:15.1.0-567.g7df2194.el8.x86_64 4/123 2020-02-12T14:11:35.568 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-immutable-object-cache-2:15.1.0-567.g7df219 5/123 2020-02-12T14:11:35.569 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mds-2:15.1.0-567.g7df2194.el8.x86_64 6/123 2020-02-12T14:11:35.569 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-2:15.1.0-567.g7df2194.el8.x86_64 7/123 2020-02-12T14:11:35.569 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mon-2:15.1.0-567.g7df2194.el8.x86_64 8/123 2020-02-12T14:11:35.569 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-osd-2:15.1.0-567.g7df2194.el8.x86_64 9/123 2020-02-12T14:11:35.571 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-radosgw-2:15.1.0-567.g7df2194.el8.x86_64 10/123 2020-02-12T14:11:35.571 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-selinux-2:15.1.0-567.g7df2194.el8.x86_64 11/123 2020-02-12T14:11:35.571 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-test-2:15.1.0-567.g7df2194.el8.x86_64 12/123 2020-02-12T14:11:35.571 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephadm-2:15.1.0-567.g7df2194.el8.x86_64 13/123 2020-02-12T14:11:35.572 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs-devel-2:15.1.0-567.g7df2194.el8.x86_64 14/123 2020-02-12T14:11:35.572 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs2-2:15.1.0-567.g7df2194.el8.x86_64 15/123 2020-02-12T14:11:35.572 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados-devel-2:15.1.0-567.g7df2194.el8.x86_64 16/123 2020-02-12T14:11:35.572 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libradosstriper1-2:15.1.0-567.g7df2194.el8.x86_6 17/123 2020-02-12T14:11:35.572 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librgw2-2:15.1.0-567.g7df2194.el8.x86_64 18/123 2020-02-12T14:11:35.572 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-argparse-2:15.1.0-567.g7df2194.el8. 19/123 2020-02-12T14:11:35.572 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-common-2:15.1.0-567.g7df2194.el8.x8 20/123 2020-02-12T14:11:35.573 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cephfs-2:15.1.0-567.g7df2194.el8.x86_64 21/123 2020-02-12T14:11:35.573 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rados-2:15.1.0-567.g7df2194.el8.x86_64 22/123 2020-02-12T14:11:35.573 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rbd-2:15.1.0-567.g7df2194.el8.x86_64 23/123 2020-02-12T14:11:35.573 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rgw-2:15.1.0-567.g7df2194.el8.x86_64 24/123 2020-02-12T14:11:35.573 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-fuse-2:15.1.0-567.g7df2194.el8.x86_64 25/123 2020-02-12T14:11:35.573 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-mirror-2:15.1.0-567.g7df2194.el8.x86_64 26/123 2020-02-12T14:11:35.573 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-nbd-2:15.1.0-567.g7df2194.el8.x86_64 27/123 2020-02-12T14:11:35.574 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-grafana-dashboards-2:15.1.0-567.g7df2194.el 28/123 2020-02-12T14:11:35.574 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-cephadm-2:15.1.0-567.g7df2194.el8.noarc 29/123 2020-02-12T14:11:35.574 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-dashboard-2:15.1.0-567.g7df2194.el8.noa 30/123 2020-02-12T14:11:35.574 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.1.0-567.g7df2 31/123 2020-02-12T14:11:35.574 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-rook-2:15.1.0-567.g7df2194.el8.noarch 32/123 2020-02-12T14:11:35.574 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : automake-1.16.1-6.el8.noarch 33/123 2020-02-12T14:11:35.574 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : bison-3.0.4-10.el8.x86_64 34/123 2020-02-12T14:11:35.574 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flex-2.6.1-9.el8.x86_64 35/123 2020-02-12T14:11:35.575 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : jq-1.5-12.el8.x86_64 36/123 2020-02-12T14:11:35.575 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 37/123 2020-02-12T14:11:35.575 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 38/123 2020-02-12T14:11:35.575 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 39/123 2020-02-12T14:11:35.575 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 40/123 2020-02-12T14:11:35.575 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 41/123 2020-02-12T14:11:35.576 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 42/123 2020-02-12T14:11:35.576 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 43/123 2020-02-12T14:11:35.576 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 44/123 2020-02-12T14:11:35.576 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 45/123 2020-02-12T14:11:35.576 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 46/123 2020-02-12T14:11:35.576 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 47/123 2020-02-12T14:11:35.577 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 48/123 2020-02-12T14:11:35.577 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 49/123 2020-02-12T14:11:35.577 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 50/123 2020-02-12T14:11:35.577 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 51/123 2020-02-12T14:11:35.577 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 52/123 2020-02-12T14:11:35.577 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 53/123 2020-02-12T14:11:35.577 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 54/123 2020-02-12T14:11:35.578 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 55/123 2020-02-12T14:11:35.578 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 56/123 2020-02-12T14:11:35.578 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 57/123 2020-02-12T14:11:35.578 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 58/123 2020-02-12T14:11:35.578 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 59/123 2020-02-12T14:11:35.578 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 60/123 2020-02-12T14:11:35.579 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 61/123 2020-02-12T14:11:35.579 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 62/123 2020-02-12T14:11:35.579 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 63/123 2020-02-12T14:11:35.579 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 64/123 2020-02-12T14:11:35.579 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 65/123 2020-02-12T14:11:35.579 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 66/123 2020-02-12T14:11:35.579 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 67/123 2020-02-12T14:11:35.579 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 68/123 2020-02-12T14:11:35.580 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 69/123 2020-02-12T14:11:35.580 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 70/123 2020-02-12T14:11:35.580 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 71/123 2020-02-12T14:11:35.580 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8.x86_64 72/123 2020-02-12T14:11:35.580 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 73/123 2020-02-12T14:11:35.580 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 74/123 2020-02-12T14:11:35.580 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 75/123 2020-02-12T14:11:35.581 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 76/123 2020-02-12T14:11:35.581 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 77/123 2020-02-12T14:11:35.581 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 78/123 2020-02-12T14:11:35.581 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 79/123 2020-02-12T14:11:35.581 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 80/123 2020-02-12T14:11:35.581 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 81/123 2020-02-12T14:11:35.581 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 82/123 2020-02-12T14:11:35.581 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 83/123 2020-02-12T14:11:35.582 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 84/123 2020-02-12T14:11:35.582 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 85/123 2020-02-12T14:11:35.582 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 86/123 2020-02-12T14:11:35.583 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 87/123 2020-02-12T14:11:35.583 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 88/123 2020-02-12T14:11:35.583 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 89/123 2020-02-12T14:11:35.583 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 90/123 2020-02-12T14:11:35.583 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 91/123 2020-02-12T14:11:35.583 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 92/123 2020-02-12T14:11:35.583 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-portend-2.6-1.el8.noarch 93/123 2020-02-12T14:11:35.584 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 94/123 2020-02-12T14:11:35.584 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 95/123 2020-02-12T14:11:35.584 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 96/123 2020-02-12T14:11:35.584 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 97/123 2020-02-12T14:11:35.584 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 98/123 2020-02-12T14:11:35.585 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 99/123 2020-02-12T14:11:35.585 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 100/123 2020-02-12T14:11:35.585 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 101/123 2020-02-12T14:11:35.585 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 102/123 2020-02-12T14:11:35.585 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 103/123 2020-02-12T14:11:35.585 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 104/123 2020-02-12T14:11:35.585 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 105/123 2020-02-12T14:11:35.585 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 106/123 2020-02-12T14:11:35.586 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 107/123 2020-02-12T14:11:35.586 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 108/123 2020-02-12T14:11:35.586 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 109/123 2020-02-12T14:11:35.586 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 110/123 2020-02-12T14:11:35.586 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 111/123 2020-02-12T14:11:35.586 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-kubernetes-10.0.1-1.el8.noarch 112/123 2020-02-12T14:11:35.586 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 113/123 2020-02-12T14:11:35.587 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 114/123 2020-02-12T14:11:35.587 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 115/123 2020-02-12T14:11:35.587 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 116/123 2020-02-12T14:11:35.587 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 117/123 2020-02-12T14:11:35.587 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : leveldb-1.21-2.el8.x86_64 118/123 2020-02-12T14:11:35.587 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xmlstarlet-1.6.1-13.el8.x86_64 119/123 2020-02-12T14:11:35.587 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:15.1.0-567.g7df2194.el8.x86_64 120/123 2020-02-12T14:11:35.588 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 121/123 2020-02-12T14:11:35.588 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:15.1.0-567.g7df2194.el8.x86_64 122/123 2020-02-12T14:11:35.690 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/123 2020-02-12T14:11:35.793 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/123 2020-02-12T14:11:36.015 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : bison-3.0.4-10.el8.x86_64 121/123 2020-02-12T14:11:36.031 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 121/123 2020-02-12T14:11:36.031 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 122/123 2020-02-12T14:11:36.260 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 122/123 2020-02-12T14:11:36.260 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 123/123 2020-02-12T14:11:37.063 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 123/123 2020-02-12T14:11:37.063 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:37.064 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2020-02-12T14:11:37.064 INFO:teuthology.orchestra.run.smithi072.stdout: librados2-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.064 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.064 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:37.064 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2020-02-12T14:11:37.064 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.065 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.065 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.065 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.065 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.065 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.065 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.065 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.066 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.066 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.066 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.066 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.066 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.067 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.067 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.067 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.067 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.067 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.067 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm-2:15.1.0-567.g7df2194.el8.noarch 2020-02-12T14:11:37.067 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard-2:15.1.0-567.g7df2194.el8.noarch 2020-02-12T14:11:37.067 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local-2:15.1.0-567.g7df2194.el8.noarch 2020-02-12T14:11:37.068 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook-2:15.1.0-567.g7df2194.el8.noarch 2020-02-12T14:11:37.068 INFO:teuthology.orchestra.run.smithi072.stdout: bison-3.0.4-10.el8.x86_64 2020-02-12T14:11:37.068 INFO:teuthology.orchestra.run.smithi072.stdout: flex-2.6.1-9.el8.x86_64 2020-02-12T14:11:37.068 INFO:teuthology.orchestra.run.smithi072.stdout: libtool-2.4.6-25.el8.x86_64 2020-02-12T14:11:37.068 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-02-12T14:11:37.068 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-02-12T14:11:37.069 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-02-12T14:11:37.069 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel-1:1.1.1c-2.el8.x86_64 2020-02-12T14:11:37.069 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-02-12T14:11:37.073 INFO:teuthology.orchestra.run.smithi072.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-02-12T14:11:37.073 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-02-12T14:11:37.073 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.074 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.074 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.074 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.074 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.075 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.075 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.075 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.075 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:37.075 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards-2:15.1.0-567.g7df2194.el8.noarch 2020-02-12T14:11:37.075 INFO:teuthology.orchestra.run.smithi072.stdout: automake-1.16.1-6.el8.noarch 2020-02-12T14:11:37.076 INFO:teuthology.orchestra.run.smithi072.stdout: jq-1.5-12.el8.x86_64 2020-02-12T14:11:37.076 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-02-12T14:11:37.076 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-02-12T14:11:37.076 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-02-12T14:11:37.076 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-0.3.3-2.el8.x86_64 2020-02-12T14:11:37.076 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-02-12T14:11:37.076 INFO:teuthology.orchestra.run.smithi072.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-02-12T14:11:37.077 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako-1.0.6-13.el8.noarch 2020-02-12T14:11:37.077 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-02-12T14:11:37.077 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-02-12T14:11:37.077 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-02-12T14:11:37.077 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-02-12T14:11:37.077 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-02-12T14:11:37.077 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-02-12T14:11:37.078 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz-2017.2-9.el8.noarch 2020-02-12T14:11:37.078 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-02-12T14:11:37.078 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-02-12T14:11:37.078 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-02-12T14:11:37.078 INFO:teuthology.orchestra.run.smithi072.stdout: socat-1.7.3.2-6.el8.x86_64 2020-02-12T14:11:37.078 INFO:teuthology.orchestra.run.smithi072.stdout: fuse-2.9.7-12.el8.x86_64 2020-02-12T14:11:37.078 INFO:teuthology.orchestra.run.smithi072.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-02-12T14:11:37.079 INFO:teuthology.orchestra.run.smithi072.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-02-12T14:11:37.079 INFO:teuthology.orchestra.run.smithi072.stdout: krb5-devel-1.17-9.el8.x86_64 2020-02-12T14:11:37.079 INFO:teuthology.orchestra.run.smithi072.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-02-12T14:11:37.079 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-02-12T14:11:37.079 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-02-12T14:11:37.079 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-02-12T14:11:37.079 INFO:teuthology.orchestra.run.smithi072.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-02-12T14:11:37.079 INFO:teuthology.orchestra.run.smithi072.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-02-12T14:11:37.080 INFO:teuthology.orchestra.run.smithi072.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-02-12T14:11:37.080 INFO:teuthology.orchestra.run.smithi072.stdout: libxslt-1.1.32-3.el8.x86_64 2020-02-12T14:11:37.080 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-02-12T14:11:37.080 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-02-12T14:11:37.080 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-02-12T14:11:37.080 INFO:teuthology.orchestra.run.smithi072.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-02-12T14:11:37.081 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-02-12T14:11:37.081 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-02-12T14:11:37.081 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-02-12T14:11:37.081 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-02-12T14:11:37.082 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-02-12T14:11:37.082 INFO:teuthology.orchestra.run.smithi072.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-02-12T14:11:37.082 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-02-12T14:11:37.082 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-02-12T14:11:37.083 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-02-12T14:11:37.083 INFO:teuthology.orchestra.run.smithi072.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-02-12T14:11:37.083 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-6.2-6.el8.noarch 2020-02-12T14:11:37.083 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-02-12T14:11:37.083 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-02-12T14:11:37.083 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-02-12T14:11:37.083 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-02-12T14:11:37.084 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend-2.6-1.el8.noarch 2020-02-12T14:11:37.084 INFO:teuthology.orchestra.run.smithi072.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-02-12T14:11:37.084 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-02-12T14:11:37.084 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes-2.4.1-12.el8.noarch 2020-02-12T14:11:37.084 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-02-12T14:11:37.084 INFO:teuthology.orchestra.run.smithi072.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-02-12T14:11:37.084 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-02-12T14:11:37.085 INFO:teuthology.orchestra.run.smithi072.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-02-12T14:11:37.085 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-02-12T14:11:37.085 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-02-12T14:11:37.085 INFO:teuthology.orchestra.run.smithi072.stdout: liboath-2.6.2-3.el8.x86_64 2020-02-12T14:11:37.085 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind-1.3.1-3.el8.x86_64 2020-02-12T14:11:37.085 INFO:teuthology.orchestra.run.smithi072.stdout: python3-apipkg-1.5-6.el8.noarch 2020-02-12T14:11:37.085 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-02-12T14:11:37.086 INFO:teuthology.orchestra.run.smithi072.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-02-12T14:11:37.086 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-02-12T14:11:37.086 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-02-12T14:11:37.086 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-02-12T14:11:37.086 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes-10.0.1-1.el8.noarch 2020-02-12T14:11:37.086 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-02-12T14:11:37.086 INFO:teuthology.orchestra.run.smithi072.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-02-12T14:11:37.086 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-02-12T14:11:37.087 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-02-12T14:11:37.087 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-02-12T14:11:37.087 INFO:teuthology.orchestra.run.smithi072.stdout: leveldb-1.21-2.el8.x86_64 2020-02-12T14:11:37.087 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet-1.6.1-13.el8.x86_64 2020-02-12T14:11:37.087 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:37.087 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2020-02-12T14:11:37.108 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 123/123 2020-02-12T14:11:37.108 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-2:15.1.0-567.g7df2194.el8.x86_64 1/123 2020-02-12T14:11:37.108 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-base-2:15.1.0-567.g7df2194.el8.x86_64 2/123 2020-02-12T14:11:37.108 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-common-2:15.1.0-567.g7df2194.el8.x86_64 3/123 2020-02-12T14:11:37.108 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-fuse-2:15.1.0-567.g7df2194.el8.x86_64 4/123 2020-02-12T14:11:37.109 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-immutable-object-cache-2:15.1.0-567.g7df219 5/123 2020-02-12T14:11:37.109 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mds-2:15.1.0-567.g7df2194.el8.x86_64 6/123 2020-02-12T14:11:37.109 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-2:15.1.0-567.g7df2194.el8.x86_64 7/123 2020-02-12T14:11:37.109 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mon-2:15.1.0-567.g7df2194.el8.x86_64 8/123 2020-02-12T14:11:37.109 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-osd-2:15.1.0-567.g7df2194.el8.x86_64 9/123 2020-02-12T14:11:37.109 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-radosgw-2:15.1.0-567.g7df2194.el8.x86_64 10/123 2020-02-12T14:11:37.110 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-selinux-2:15.1.0-567.g7df2194.el8.x86_64 11/123 2020-02-12T14:11:37.110 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-test-2:15.1.0-567.g7df2194.el8.x86_64 12/123 2020-02-12T14:11:37.110 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephadm-2:15.1.0-567.g7df2194.el8.x86_64 13/123 2020-02-12T14:11:37.110 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs-devel-2:15.1.0-567.g7df2194.el8.x86_64 14/123 2020-02-12T14:11:37.110 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs2-2:15.1.0-567.g7df2194.el8.x86_64 15/123 2020-02-12T14:11:37.110 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados-devel-2:15.1.0-567.g7df2194.el8.x86_64 16/123 2020-02-12T14:11:37.110 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libradosstriper1-2:15.1.0-567.g7df2194.el8.x86_6 17/123 2020-02-12T14:11:37.111 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librgw2-2:15.1.0-567.g7df2194.el8.x86_64 18/123 2020-02-12T14:11:37.111 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-argparse-2:15.1.0-567.g7df2194.el8. 19/123 2020-02-12T14:11:37.111 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-common-2:15.1.0-567.g7df2194.el8.x8 20/123 2020-02-12T14:11:37.111 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cephfs-2:15.1.0-567.g7df2194.el8.x86_64 21/123 2020-02-12T14:11:37.111 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rados-2:15.1.0-567.g7df2194.el8.x86_64 22/123 2020-02-12T14:11:37.111 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rbd-2:15.1.0-567.g7df2194.el8.x86_64 23/123 2020-02-12T14:11:37.111 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rgw-2:15.1.0-567.g7df2194.el8.x86_64 24/123 2020-02-12T14:11:37.111 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-fuse-2:15.1.0-567.g7df2194.el8.x86_64 25/123 2020-02-12T14:11:37.112 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-mirror-2:15.1.0-567.g7df2194.el8.x86_64 26/123 2020-02-12T14:11:37.112 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-nbd-2:15.1.0-567.g7df2194.el8.x86_64 27/123 2020-02-12T14:11:37.112 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-grafana-dashboards-2:15.1.0-567.g7df2194.el 28/123 2020-02-12T14:11:37.112 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-cephadm-2:15.1.0-567.g7df2194.el8.noarc 29/123 2020-02-12T14:11:37.112 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-dashboard-2:15.1.0-567.g7df2194.el8.noa 30/123 2020-02-12T14:11:37.112 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.1.0-567.g7df2 31/123 2020-02-12T14:11:37.112 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-rook-2:15.1.0-567.g7df2194.el8.noarch 32/123 2020-02-12T14:11:37.113 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : automake-1.16.1-6.el8.noarch 33/123 2020-02-12T14:11:37.113 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : bison-3.0.4-10.el8.x86_64 34/123 2020-02-12T14:11:37.113 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flex-2.6.1-9.el8.x86_64 35/123 2020-02-12T14:11:37.113 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : jq-1.5-12.el8.x86_64 36/123 2020-02-12T14:11:37.113 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 37/123 2020-02-12T14:11:37.113 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 38/123 2020-02-12T14:11:37.113 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 39/123 2020-02-12T14:11:37.114 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 40/123 2020-02-12T14:11:37.114 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 41/123 2020-02-12T14:11:37.114 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 42/123 2020-02-12T14:11:37.115 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 43/123 2020-02-12T14:11:37.115 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 44/123 2020-02-12T14:11:37.115 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 45/123 2020-02-12T14:11:37.116 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 46/123 2020-02-12T14:11:37.116 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 47/123 2020-02-12T14:11:37.117 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 48/123 2020-02-12T14:11:37.117 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 49/123 2020-02-12T14:11:37.118 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 50/123 2020-02-12T14:11:37.118 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 51/123 2020-02-12T14:11:37.118 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 52/123 2020-02-12T14:11:37.118 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 53/123 2020-02-12T14:11:37.118 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 54/123 2020-02-12T14:11:37.118 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 55/123 2020-02-12T14:11:37.118 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 56/123 2020-02-12T14:11:37.118 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 57/123 2020-02-12T14:11:37.119 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 58/123 2020-02-12T14:11:37.119 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 59/123 2020-02-12T14:11:37.119 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 60/123 2020-02-12T14:11:37.119 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 61/123 2020-02-12T14:11:37.119 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 62/123 2020-02-12T14:11:37.119 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 63/123 2020-02-12T14:11:37.120 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 64/123 2020-02-12T14:11:37.120 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 65/123 2020-02-12T14:11:37.121 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 66/123 2020-02-12T14:11:37.121 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 67/123 2020-02-12T14:11:37.121 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 68/123 2020-02-12T14:11:37.122 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 69/123 2020-02-12T14:11:37.122 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 70/123 2020-02-12T14:11:37.123 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 71/123 2020-02-12T14:11:37.123 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8.x86_64 72/123 2020-02-12T14:11:37.123 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 73/123 2020-02-12T14:11:37.123 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 74/123 2020-02-12T14:11:37.123 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 75/123 2020-02-12T14:11:37.123 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 76/123 2020-02-12T14:11:37.124 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 77/123 2020-02-12T14:11:37.124 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 78/123 2020-02-12T14:11:37.124 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 79/123 2020-02-12T14:11:37.125 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 80/123 2020-02-12T14:11:37.125 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 81/123 2020-02-12T14:11:37.125 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 82/123 2020-02-12T14:11:37.126 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 83/123 2020-02-12T14:11:37.126 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 84/123 2020-02-12T14:11:37.126 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 85/123 2020-02-12T14:11:37.126 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 86/123 2020-02-12T14:11:37.126 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 87/123 2020-02-12T14:11:37.126 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 88/123 2020-02-12T14:11:37.126 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 89/123 2020-02-12T14:11:37.127 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 90/123 2020-02-12T14:11:37.127 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 91/123 2020-02-12T14:11:37.127 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 92/123 2020-02-12T14:11:37.127 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-portend-2.6-1.el8.noarch 93/123 2020-02-12T14:11:37.127 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 94/123 2020-02-12T14:11:37.127 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 95/123 2020-02-12T14:11:37.127 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 96/123 2020-02-12T14:11:37.127 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 97/123 2020-02-12T14:11:37.128 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 98/123 2020-02-12T14:11:37.128 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 99/123 2020-02-12T14:11:37.128 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 100/123 2020-02-12T14:11:37.129 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 101/123 2020-02-12T14:11:37.129 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 102/123 2020-02-12T14:11:37.129 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 103/123 2020-02-12T14:11:37.129 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 104/123 2020-02-12T14:11:37.129 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 105/123 2020-02-12T14:11:37.129 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 106/123 2020-02-12T14:11:37.130 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 107/123 2020-02-12T14:11:37.130 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 108/123 2020-02-12T14:11:37.130 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 109/123 2020-02-12T14:11:37.130 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 110/123 2020-02-12T14:11:37.130 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 111/123 2020-02-12T14:11:37.130 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-kubernetes-10.0.1-1.el8.noarch 112/123 2020-02-12T14:11:37.130 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 113/123 2020-02-12T14:11:37.131 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 114/123 2020-02-12T14:11:37.131 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 115/123 2020-02-12T14:11:37.131 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 116/123 2020-02-12T14:11:37.131 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 117/123 2020-02-12T14:11:37.131 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : leveldb-1.21-2.el8.x86_64 118/123 2020-02-12T14:11:37.131 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : xmlstarlet-1.6.1-13.el8.x86_64 119/123 2020-02-12T14:11:37.131 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-2:15.1.0-567.g7df2194.el8.x86_64 120/123 2020-02-12T14:11:37.131 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 121/123 2020-02-12T14:11:37.132 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-2:15.1.0-567.g7df2194.el8.x86_64 122/123 2020-02-12T14:11:37.239 DEBUG:teuthology.parallel:result is None 2020-02-12T14:11:38.556 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 123/123 2020-02-12T14:11:38.556 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:38.556 INFO:teuthology.orchestra.run.smithi139.stdout:Upgraded: 2020-02-12T14:11:38.556 INFO:teuthology.orchestra.run.smithi139.stdout: librados2-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.557 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.557 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:38.557 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2020-02-12T14:11:38.557 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.557 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.557 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.558 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.558 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.558 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.558 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.558 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.558 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.558 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.558 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.559 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.559 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.559 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.559 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.559 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.559 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.559 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.560 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm-2:15.1.0-567.g7df2194.el8.noarch 2020-02-12T14:11:38.560 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard-2:15.1.0-567.g7df2194.el8.noarch 2020-02-12T14:11:38.560 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local-2:15.1.0-567.g7df2194.el8.noarch 2020-02-12T14:11:38.560 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook-2:15.1.0-567.g7df2194.el8.noarch 2020-02-12T14:11:38.560 INFO:teuthology.orchestra.run.smithi139.stdout: bison-3.0.4-10.el8.x86_64 2020-02-12T14:11:38.560 INFO:teuthology.orchestra.run.smithi139.stdout: flex-2.6.1-9.el8.x86_64 2020-02-12T14:11:38.560 INFO:teuthology.orchestra.run.smithi139.stdout: libtool-2.4.6-25.el8.x86_64 2020-02-12T14:11:38.560 INFO:teuthology.orchestra.run.smithi139.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-02-12T14:11:38.561 INFO:teuthology.orchestra.run.smithi139.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-02-12T14:11:38.561 INFO:teuthology.orchestra.run.smithi139.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-02-12T14:11:38.561 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-devel-1:1.1.1c-2.el8.x86_64 2020-02-12T14:11:38.561 INFO:teuthology.orchestra.run.smithi139.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-02-12T14:11:38.561 INFO:teuthology.orchestra.run.smithi139.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-02-12T14:11:38.561 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-02-12T14:11:38.562 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.562 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.562 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.562 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.562 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.562 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.562 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.563 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.563 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T14:11:38.563 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards-2:15.1.0-567.g7df2194.el8.noarch 2020-02-12T14:11:38.563 INFO:teuthology.orchestra.run.smithi139.stdout: automake-1.16.1-6.el8.noarch 2020-02-12T14:11:38.563 INFO:teuthology.orchestra.run.smithi139.stdout: jq-1.5-12.el8.x86_64 2020-02-12T14:11:38.563 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-02-12T14:11:38.563 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-02-12T14:11:38.564 INFO:teuthology.orchestra.run.smithi139.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-02-12T14:11:38.564 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-0.3.3-2.el8.x86_64 2020-02-12T14:11:38.564 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-02-12T14:11:38.564 INFO:teuthology.orchestra.run.smithi139.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-02-12T14:11:38.564 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako-1.0.6-13.el8.noarch 2020-02-12T14:11:38.564 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-02-12T14:11:38.564 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-02-12T14:11:38.565 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-02-12T14:11:38.565 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-02-12T14:11:38.565 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-02-12T14:11:38.565 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-02-12T14:11:38.565 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz-2017.2-9.el8.noarch 2020-02-12T14:11:38.565 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-02-12T14:11:38.565 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-02-12T14:11:38.566 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-02-12T14:11:38.566 INFO:teuthology.orchestra.run.smithi139.stdout: socat-1.7.3.2-6.el8.x86_64 2020-02-12T14:11:38.566 INFO:teuthology.orchestra.run.smithi139.stdout: fuse-2.9.7-12.el8.x86_64 2020-02-12T14:11:38.566 INFO:teuthology.orchestra.run.smithi139.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-02-12T14:11:38.566 INFO:teuthology.orchestra.run.smithi139.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-02-12T14:11:38.566 INFO:teuthology.orchestra.run.smithi139.stdout: krb5-devel-1.17-9.el8.x86_64 2020-02-12T14:11:38.566 INFO:teuthology.orchestra.run.smithi139.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-02-12T14:11:38.566 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-02-12T14:11:38.567 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-02-12T14:11:38.567 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-02-12T14:11:38.567 INFO:teuthology.orchestra.run.smithi139.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-02-12T14:11:38.567 INFO:teuthology.orchestra.run.smithi139.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-02-12T14:11:38.567 INFO:teuthology.orchestra.run.smithi139.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-02-12T14:11:38.567 INFO:teuthology.orchestra.run.smithi139.stdout: libxslt-1.1.32-3.el8.x86_64 2020-02-12T14:11:38.567 INFO:teuthology.orchestra.run.smithi139.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-02-12T14:11:38.568 INFO:teuthology.orchestra.run.smithi139.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-02-12T14:11:38.568 INFO:teuthology.orchestra.run.smithi139.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-02-12T14:11:38.568 INFO:teuthology.orchestra.run.smithi139.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-02-12T14:11:38.568 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-02-12T14:11:38.568 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-02-12T14:11:38.568 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-02-12T14:11:38.568 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-02-12T14:11:38.569 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-02-12T14:11:38.569 INFO:teuthology.orchestra.run.smithi139.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-02-12T14:11:38.569 INFO:teuthology.orchestra.run.smithi139.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-02-12T14:11:38.569 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-02-12T14:11:38.569 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-02-12T14:11:38.569 INFO:teuthology.orchestra.run.smithi139.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-02-12T14:11:38.569 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-6.2-6.el8.noarch 2020-02-12T14:11:38.570 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-02-12T14:11:38.570 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-02-12T14:11:38.570 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-02-12T14:11:38.570 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-02-12T14:11:38.570 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend-2.6-1.el8.noarch 2020-02-12T14:11:38.570 INFO:teuthology.orchestra.run.smithi139.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-02-12T14:11:38.570 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-02-12T14:11:38.571 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes-2.4.1-12.el8.noarch 2020-02-12T14:11:38.571 INFO:teuthology.orchestra.run.smithi139.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-02-12T14:11:38.571 INFO:teuthology.orchestra.run.smithi139.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-02-12T14:11:38.571 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-02-12T14:11:38.571 INFO:teuthology.orchestra.run.smithi139.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-02-12T14:11:38.571 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-02-12T14:11:38.571 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-02-12T14:11:38.572 INFO:teuthology.orchestra.run.smithi139.stdout: liboath-2.6.2-3.el8.x86_64 2020-02-12T14:11:38.572 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind-1.3.1-3.el8.x86_64 2020-02-12T14:11:38.572 INFO:teuthology.orchestra.run.smithi139.stdout: python3-apipkg-1.5-6.el8.noarch 2020-02-12T14:11:38.572 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-02-12T14:11:38.572 INFO:teuthology.orchestra.run.smithi139.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-02-12T14:11:38.572 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-02-12T14:11:38.572 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-02-12T14:11:38.573 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-02-12T14:11:38.573 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes-10.0.1-1.el8.noarch 2020-02-12T14:11:38.573 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-02-12T14:11:38.573 INFO:teuthology.orchestra.run.smithi139.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-02-12T14:11:38.573 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-02-12T14:11:38.573 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-02-12T14:11:38.573 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-02-12T14:11:38.574 INFO:teuthology.orchestra.run.smithi139.stdout: leveldb-1.21-2.el8.x86_64 2020-02-12T14:11:38.574 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet-1.6.1-13.el8.x86_64 2020-02-12T14:11:38.574 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:38.574 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2020-02-12T14:11:38.699 DEBUG:teuthology.parallel:result is None 2020-02-12T14:11:38.699 INFO:teuthology.orchestra.run.smithi072:> sudo lsb_release -is 2020-02-12T14:11:38.745 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS 2020-02-12T14:11:38.746 DEBUG:teuthology.misc:System to be installed: CentOS 2020-02-12T14:11:38.747 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7df2194963eaa185d198b9c90e899c7e7ae9eb30 2020-02-12T14:11:38.903 INFO:teuthology.orchestra.run.smithi072:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-02-12T14:11:38.925 INFO:teuthology.orchestra.run.smithi072.stdout:15.1.0-567.g7df2194.el8 2020-02-12T14:11:38.925 INFO:teuthology.packaging:The installed version of ceph is 15.1.0-567.g7df2194.el8 2020-02-12T14:11:38.926 INFO:teuthology.task.install:The correct ceph version 15.1.0-567.g7df2194 is installed. 2020-02-12T14:11:38.926 INFO:teuthology.orchestra.run.smithi139:> sudo lsb_release -is 2020-02-12T14:11:38.976 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS 2020-02-12T14:11:38.977 DEBUG:teuthology.misc:System to be installed: CentOS 2020-02-12T14:11:38.977 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7df2194963eaa185d198b9c90e899c7e7ae9eb30 2020-02-12T14:11:39.144 INFO:teuthology.orchestra.run.smithi139:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-02-12T14:11:39.164 INFO:teuthology.orchestra.run.smithi139.stdout:15.1.0-567.g7df2194.el8 2020-02-12T14:11:39.164 INFO:teuthology.packaging:The installed version of ceph is 15.1.0-567.g7df2194.el8 2020-02-12T14:11:39.164 INFO:teuthology.task.install:The correct ceph version 15.1.0-567.g7df2194 is installed. 2020-02-12T14:11:39.164 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-02-12T14:11:39.165 INFO:teuthology.orchestra.run.smithi072:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-02-12T14:11:39.194 INFO:teuthology.orchestra.run.smithi139:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-02-12T14:11:39.233 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-02-12T14:11:39.233 INFO:teuthology.orchestra.run.smithi072:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-02-12T14:11:39.262 INFO:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-02-12T14:11:39.330 INFO:teuthology.orchestra.run.smithi139:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-02-12T14:11:39.361 INFO:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-02-12T14:11:39.429 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-02-12T14:11:39.430 INFO:teuthology.orchestra.run.smithi072:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-02-12T14:11:39.481 INFO:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-02-12T14:11:39.548 INFO:teuthology.orchestra.run.smithi139:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-02-12T14:11:39.593 INFO:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-02-12T14:11:39.660 INFO:teuthology.run_tasks:Running task ceph... 2020-02-12T14:11:39.753 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-02-12T14:11:39.753 INFO:teuthology.orchestra.run.smithi072:> sudo chmod 777 /var/log/ceph 2020-02-12T14:11:39.756 INFO:teuthology.orchestra.run.smithi139:> sudo chmod 777 /var/log/ceph 2020-02-12T14:11:39.783 INFO:tasks.ceph:Disabling ceph logrotate... 2020-02-12T14:11:39.783 INFO:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/logrotate.d/ceph 2020-02-12T14:11:39.823 INFO:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/logrotate.d/ceph 2020-02-12T14:11:39.850 INFO:tasks.ceph:Creating extra log directories... 2020-02-12T14:11:39.850 INFO:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-02-12T14:11:39.894 INFO:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-02-12T14:11:39.921 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2020-02-12T14:11:39.921 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2020-02-12T14:11:39.923 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2020-02-12T14:11:39.923 INFO:teuthology.orchestra.run.smithi072:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-02-12T14:11:40.006 INFO:teuthology.orchestra.run.smithi072:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-02-12T14:11:40.120 INFO:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-02-12T14:11:40.151 INFO:teuthology.orchestra.run.smithi139:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-02-12T14:11:40.199 INFO:teuthology.orchestra.run.smithi139:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-02-12T14:11:40.312 INFO:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-02-12T14:11:40.339 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-02-12T14:11:40.339 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'block_journal': None, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'tmpfs_journal': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds bal split size': 100, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'client': {'fuse set user groups': True, 'debug ms': 1, 'fuse default permissions': False, 'debug client': 20, 'client mount timeout': 600}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon op complaint time': 120, 'debug ms': 1}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'debug journal': 20, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'osd_max_omap_entries_per_request': 10000, 'bluestore fsck on mount': True, 'debug rocksdb': 10, 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'osd failsafe full ratio': 0.95, 'bluestore block size': 96636764160, 'debug filestore': 20, 'osd op complaint time': 180}}} 2020-02-12T14:11:40.339 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'sha1': '7df2194963eaa185d198b9c90e899c7e7ae9eb30'}}, {'ceph': None}, {'exec': {'client.0': ['sudo ceph fs set cephfs inline_data true --yes-i-really-really-mean-it']}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/pjd.sh']}, 'timeout': '6h'}}], 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200211.222321/qa', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.11870', 'owner': 'scheduled_pdonnell@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'targets': {'smithi139.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwiFjJCK9g9UbnDOuaOCMFVr9ptdtMvb4kdC/Co8sxcPmBixcOvVlVGRlqqD9T+J0a2AOq4A3IBemCOWqxZyw6XYP/Mt63asiUFZwfTcqVL033j5II8cmOdf1+QYLaBcOeLIfvr+nzDlczklXJ4rT1v7ZJRHJRfRP5m0gQxcyXwQvErxbN161tmmdK8xPb8AKw1x2PD2iiAVzUkv7RRAb4JQ+kxicWKnVoLVgNKKZNYe744lg9v4z+GjqRW22TtnKSj760WJ9Dtqlwvbm8v27KvZM+2B2b01GJeCTeWB96EKVBhDLNsL/mb1GCLHzCJ1bNwr16k/cJ2dYCGKIXSRhDa8jyC9i+9L3kgme/TJKMjq7m/SogLJCJFOpghZ9WZ8/odGksFwI9Ctu52Z3rpUWVvfiDMMssb9hD0oBqag33kAxrCgGMi8UkB9cFY5TE8OdI1J5WyMpEVmTuLmnIGmmzMRPj6zfaNgGaeaTak+BZN2mAWUZIF4ksxg42rhwWSe8=', 'smithi072.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnHMvD6RQ6Q8i47DmZmyGMSc70N3w8B9n1FuwiNM/AnD/whcV/HceCP0uR4TmpPLrmesyuk4OxyK4VHBJWWCBxc9+2KwAIJDU24Dw3Pu5CQEyFH8GDn62BWnCBIswY3XrlU7JAceZUCk+/B++dRDA0QdpJfRZ+TnvXf4yfxuc1qS1pe7wSNKwdehOxHVmzJmYVRzAnEMCm9ID4qb9PxAVYEuyPOFl55NpDmsqAqgx3+V6G4XEh2j5HbWxgpDq/3ALTrFx3zQSKykW87vOFMcQE1EhVq6UHYWtJtipOnlg/jtezqiyrC0iZ3XkLhoLC9C3lVOtDQi7Bs24t54uJ8oYFPygRw0KH8bDz9dlaBTSz7PpLJqv9pqkpciKH3Tn90peYhRJ8llr958V1MShYbRBmyO5+TNNcIr0M8Zu/42S8nMV+8HL4sJTYuOMvPP28QyPenadQIo+VaY4hwB72BovsYxr6rlBg6JR4ECUDhiVPB5S3RERIS2C3baT9paMPXIs='}, 'job_id': '4755697', 'tube': 'smithi', 'suite_branch': 'wip-pdonnell-testing-20200211.222321', 'priority': 75, 'os_version': '8.1', 'first_in_suite': False, 'branch': 'wip-pdonnell-testing-20200211.222321', 'suite': 'fs', 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'email': 'pdonnell@redhat.com', 'archive_path': '/home/teuthworker/archive/pdonnell-2020-02-12_01:56:22-fs-wip-pdonnell-testing-20200211.222321-distro-basic-smithi/4755697', 'description': 'fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_suites_pjd.yaml}', 'nuke-on-error': True, 'repo': 'git://git.ceph.com/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': '7df2194963eaa185d198b9c90e899c7e7ae9eb30', 'name': 'pdonnell-2020-02-12_01:56:22-fs-wip-pdonnell-testing-20200211.222321-distro-basic-smithi', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'overrides': {'ceph': {'cephfs_ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds bal split size': 100, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'client': {'fuse set user groups': True, 'debug ms': 1, 'fuse default permissions': False, 'debug client': 20, 'client mount timeout': 600}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon op complaint time': 120, 'debug ms': 1}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'debug journal': 20, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'osd_max_omap_entries_per_request': 10000, 'bluestore fsck on mount': True, 'debug rocksdb': 10, 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'osd failsafe full ratio': 0.95, 'bluestore block size': 96636764160, 'debug filestore': 20, 'osd op complaint time': 180}}, 'fs': 'xfs', 'sha1': '7df2194963eaa185d198b9c90e899c7e7ae9eb30'}, 'thrashosds': {'bdev_inject_crash_probability': 0.5, 'bdev_inject_crash': 2}, 'ceph-deploy': {'fs': 'xfs', 'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'mon osd full ratio': 0.9, 'mon osd backfillfull_ratio': 0.85, 'bluestore fsck on mount': True, 'mon osd nearfull ratio': 0.8, 'debug bluestore': 20, 'debug bluefs': 20, 'osd objectstore': 'bluestore', 'bluestore block size': 96636764160, 'debug rocksdb': 10, 'osd failsafe full ratio': 0.95}}}, 'install': {'ceph': {'sha1': '7df2194963eaa185d198b9c90e899c7e7ae9eb30'}}, 'admin_socket': {'branch': 'wip-pdonnell-testing-20200211.222321'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'workunit': {'sha1': '7df2194963eaa185d198b9c90e899c7e7ae9eb30', 'branch': 'wip-pdonnell-testing-20200211.222321'}}, 'os_type': 'centos', 'suite_sha1': '7df2194963eaa185d198b9c90e899c7e7ae9eb30'} 2020-02-12T14:11:40.340 INFO:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-02-12T14:11:40.343 INFO:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-02-12T14:11:40.393 INFO:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/run/ceph 2020-02-12T14:11:40.397 INFO:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/run/ceph 2020-02-12T14:11:40.478 DEBUG:teuthology.orchestra.remote:smithi072:/scratch_devs is 72B 2020-02-12T14:11:40.526 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-02-12T14:11:40.526 INFO:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-02-12T14:11:40.540 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-02-12T14:11:40.540 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-02-12T14:11:40.541 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 52137 Links: 1 2020-02-12T14:11:40.541 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-12T14:11:40.541 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2020-02-12T14:11:40.541 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2020-02-12 14:11:35.199105941 +0000 2020-02-12T14:11:40.541 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2020-02-12 14:09:39.486275809 +0000 2020-02-12T14:11:40.541 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2020-02-12 14:09:39.486275809 +0000 2020-02-12T14:11:40.542 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2020-02-12T14:11:40.555 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2020-02-12T14:11:40.555 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2020-02-12T14:11:40.555 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000220988 s, 2.3 MB/s 2020-02-12T14:11:40.556 INFO:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-02-12T14:11:40.611 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-02-12T14:11:40.611 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-02-12T14:11:40.611 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 58542 Links: 1 2020-02-12T14:11:40.611 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-12T14:11:40.611 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2020-02-12T14:11:40.611 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2020-02-12 14:11:35.199105941 +0000 2020-02-12T14:11:40.612 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2020-02-12 14:09:39.833268242 +0000 2020-02-12T14:11:40.612 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2020-02-12 14:09:39.833268242 +0000 2020-02-12T14:11:40.612 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2020-02-12T14:11:40.624 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2020-02-12T14:11:40.624 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2020-02-12T14:11:40.624 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000159327 s, 3.2 MB/s 2020-02-12T14:11:40.626 INFO:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-02-12T14:11:40.681 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-02-12T14:11:40.681 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-02-12T14:11:40.681 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 56790 Links: 1 2020-02-12T14:11:40.681 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-12T14:11:40.681 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2020-02-12T14:11:40.682 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2020-02-12 14:11:35.199105941 +0000 2020-02-12T14:11:40.682 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2020-02-12 14:09:40.164261023 +0000 2020-02-12T14:11:40.682 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2020-02-12 14:09:40.164261023 +0000 2020-02-12T14:11:40.682 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2020-02-12T14:11:40.694 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2020-02-12T14:11:40.694 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2020-02-12T14:11:40.694 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000185287 s, 2.8 MB/s 2020-02-12T14:11:40.696 INFO:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-02-12T14:11:40.751 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-02-12T14:11:40.751 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-02-12T14:11:40.751 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 55252 Links: 1 2020-02-12T14:11:40.751 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-12T14:11:40.751 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2020-02-12T14:11:40.752 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2020-02-12 14:11:35.199105941 +0000 2020-02-12T14:11:40.752 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2020-02-12 14:09:40.506253565 +0000 2020-02-12T14:11:40.752 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2020-02-12 14:09:40.506253565 +0000 2020-02-12T14:11:40.752 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2020-02-12T14:11:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2020-02-12T14:11:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2020-02-12T14:11:40.765 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000287586 s, 1.8 MB/s 2020-02-12T14:11:40.767 INFO:tasks.ceph:fs option selected, checking for scratch devs 2020-02-12T14:11:40.767 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-02-12T14:11:40.767 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2020-02-12T14:11:40.768 INFO:tasks.ceph:dev map: {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-02-12T14:11:40.785 DEBUG:teuthology.orchestra.remote:smithi139:/scratch_devs is 72B 2020-02-12T14:11:40.835 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-02-12T14:11:40.835 INFO:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-02-12T14:11:40.851 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-02-12T14:11:40.851 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-02-12T14:11:40.851 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 6h/6d Inode: 55258 Links: 1 2020-02-12T14:11:40.851 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-12T14:11:40.852 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2020-02-12T14:11:40.852 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2020-02-12 14:11:36.759155123 +0000 2020-02-12T14:11:40.852 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2020-02-12 14:09:39.498008083 +0000 2020-02-12T14:11:40.852 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2020-02-12 14:09:39.498008083 +0000 2020-02-12T14:11:40.852 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2020-02-12T14:11:40.865 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2020-02-12T14:11:40.865 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2020-02-12T14:11:40.865 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000201095 s, 2.5 MB/s 2020-02-12T14:11:40.869 INFO:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-02-12T14:11:40.928 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-02-12T14:11:40.928 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-02-12T14:11:40.928 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 6h/6d Inode: 55806 Links: 1 2020-02-12T14:11:40.928 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-12T14:11:40.929 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2020-02-12T14:11:40.929 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2020-02-12 14:11:36.760155101 +0000 2020-02-12T14:11:40.929 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2020-02-12 14:09:39.835000826 +0000 2020-02-12T14:11:40.929 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2020-02-12 14:09:39.835000826 +0000 2020-02-12T14:11:40.929 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2020-02-12T14:11:40.935 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2020-02-12T14:11:40.935 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2020-02-12T14:11:40.936 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000156642 s, 3.3 MB/s 2020-02-12T14:11:40.937 INFO:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-02-12T14:11:40.991 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-02-12T14:11:40.992 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-02-12T14:11:40.992 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 6h/6d Inode: 56831 Links: 1 2020-02-12T14:11:40.992 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-12T14:11:40.992 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2020-02-12T14:11:40.992 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2020-02-12 14:11:36.760155101 +0000 2020-02-12T14:11:40.992 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2020-02-12 14:09:40.173993525 +0000 2020-02-12T14:11:40.993 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2020-02-12 14:09:40.173993525 +0000 2020-02-12T14:11:40.993 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2020-02-12T14:11:41.005 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2020-02-12T14:11:41.005 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2020-02-12T14:11:41.005 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000233297 s, 2.2 MB/s 2020-02-12T14:11:41.007 INFO:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-02-12T14:11:41.062 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-02-12T14:11:41.062 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-02-12T14:11:41.062 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 6h/6d Inode: 60586 Links: 1 2020-02-12T14:11:41.062 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-12T14:11:41.062 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2020-02-12T14:11:41.063 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2020-02-12 14:11:36.760155101 +0000 2020-02-12T14:11:41.063 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2020-02-12 14:09:40.509986288 +0000 2020-02-12T14:11:41.063 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2020-02-12 14:09:40.509986288 +0000 2020-02-12T14:11:41.063 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2020-02-12T14:11:41.075 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2020-02-12T14:11:41.075 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2020-02-12T14:11:41.075 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000287261 s, 1.8 MB/s 2020-02-12T14:11:41.078 INFO:tasks.ceph:fs option selected, checking for scratch devs 2020-02-12T14:11:41.078 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-02-12T14:11:41.078 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2020-02-12T14:11:41.078 INFO:tasks.ceph:dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-02-12T14:11:41.079 INFO:tasks.ceph:Generating config... 2020-02-12T14:11:41.083 INFO:tasks.ceph:[mds] mds debug frag = True 2020-02-12T14:11:41.083 INFO:tasks.ceph:[mds] mds bal split bits = 3 2020-02-12T14:11:41.083 INFO:tasks.ceph:[mds] mds bal split size = 100 2020-02-12T14:11:41.083 INFO:tasks.ceph:[mds] debug mds = 20 2020-02-12T14:11:41.084 INFO:tasks.ceph:[mds] mds bal merge size = 5 2020-02-12T14:11:41.084 INFO:tasks.ceph:[mds] debug ms = 1 2020-02-12T14:11:41.084 INFO:tasks.ceph:[mds] mds bal frag = True 2020-02-12T14:11:41.084 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2020-02-12T14:11:41.084 INFO:tasks.ceph:[mds] mds op complaint time = 180 2020-02-12T14:11:41.084 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2020-02-12T14:11:41.084 INFO:tasks.ceph:[mds] osd op complaint time = 180 2020-02-12T14:11:41.085 INFO:tasks.ceph:[mds] mds verify scatter = True 2020-02-12T14:11:41.085 INFO:tasks.ceph:[client] fuse set user groups = True 2020-02-12T14:11:41.085 INFO:tasks.ceph:[client] debug ms = 1 2020-02-12T14:11:41.085 INFO:tasks.ceph:[client] fuse default permissions = False 2020-02-12T14:11:41.085 INFO:tasks.ceph:[client] debug client = 20 2020-02-12T14:11:41.085 INFO:tasks.ceph:[client] client mount timeout = 600 2020-02-12T14:11:41.085 INFO:tasks.ceph:[mon] debug mon = 20 2020-02-12T14:11:41.086 INFO:tasks.ceph:[mon] debug paxos = 20 2020-02-12T14:11:41.086 INFO:tasks.ceph:[mon] mon op complaint time = 120 2020-02-12T14:11:41.086 INFO:tasks.ceph:[mon] debug ms = 1 2020-02-12T14:11:41.086 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-02-12T14:11:41.086 INFO:tasks.ceph:[osd] debug ms = 1 2020-02-12T14:11:41.086 INFO:tasks.ceph:[osd] debug journal = 20 2020-02-12T14:11:41.086 INFO:tasks.ceph:[osd] debug osd = 25 2020-02-12T14:11:41.086 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-02-12T14:11:41.087 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-02-12T14:11:41.087 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-02-12T14:11:41.087 INFO:tasks.ceph:[osd] osd_max_omap_entries_per_request = 10000 2020-02-12T14:11:41.087 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-02-12T14:11:41.087 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-02-12T14:11:41.087 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-02-12T14:11:41.087 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-02-12T14:11:41.087 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-02-12T14:11:41.087 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-02-12T14:11:41.088 INFO:tasks.ceph:[osd] debug filestore = 20 2020-02-12T14:11:41.088 INFO:tasks.ceph:[osd] osd op complaint time = 180 2020-02-12T14:11:41.088 INFO:tasks.ceph:Setting up mon.a... 2020-02-12T14:11:41.088 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-02-12T14:11:41.207 INFO:teuthology.orchestra.run.smithi139.stdout:creating /etc/ceph/ceph.keyring 2020-02-12T14:11:41.210 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-02-12T14:11:41.250 INFO:teuthology.orchestra.run.smithi139:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-02-12T14:11:41.317 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.139'), ('mon.c', '[v2:172.21.15.72:3301,v1:172.21.15.72:6790]'), ('mon.b', '172.21.15.72')] 2020-02-12T14:11:41.317 INFO:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.139 --addv c '[v2:172.21.15.72:3301,v1:172.21.15.72:6790]' --add b 172.21.15.72 --print /home/ubuntu/cephtest/ceph.monmap 2020-02-12T14:11:41.393 INFO:teuthology.orchestra.run.smithi139.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-02-12T14:11:41.393 INFO:teuthology.orchestra.run.smithi139.stdout:monmaptool: generated fsid dacc9a6c-9e88-46ac-940b-c4a329dbffec 2020-02-12T14:11:41.393 INFO:teuthology.orchestra.run.smithi139.stdout:epoch 0 2020-02-12T14:11:41.394 INFO:teuthology.orchestra.run.smithi139.stdout:fsid dacc9a6c-9e88-46ac-940b-c4a329dbffec 2020-02-12T14:11:41.394 INFO:teuthology.orchestra.run.smithi139.stdout:last_changed 2020-02-12T14:11:41.392625+0000 2020-02-12T14:11:41.394 INFO:teuthology.orchestra.run.smithi139.stdout:created 2020-02-12T14:11:41.392625+0000 2020-02-12T14:11:41.394 INFO:teuthology.orchestra.run.smithi139.stdout:min_mon_release 0 (unknown) 2020-02-12T14:11:41.394 INFO:teuthology.orchestra.run.smithi139.stdout:0: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.a 2020-02-12T14:11:41.394 INFO:teuthology.orchestra.run.smithi139.stdout:1: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.b 2020-02-12T14:11:41.394 INFO:teuthology.orchestra.run.smithi139.stdout:2: [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] mon.c 2020-02-12T14:11:41.394 INFO:teuthology.orchestra.run.smithi139.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-02-12T14:11:41.396 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID dacc9a6c-9e88-46ac-940b-c4a329dbffec... 2020-02-12T14:11:41.397 INFO:teuthology.orchestra.run.smithi072:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-02-12T14:11:41.399 INFO:teuthology.orchestra.run.smithi139:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-02-12T14:11:41.450 INFO:teuthology.orchestra.run.smithi072.stdout:[global] 2020-02-12T14:11:41.450 INFO:teuthology.orchestra.run.smithi072.stdout: chdir = "" 2020-02-12T14:11:41.450 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-02-12T14:11:41.451 INFO:teuthology.orchestra.run.smithi072.stdout: auth supported = cephx 2020-02-12T14:11:41.451 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:41.451 INFO:teuthology.orchestra.run.smithi072.stdout: filestore xattr use omap = true 2020-02-12T14:11:41.451 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:41.451 INFO:teuthology.orchestra.run.smithi072.stdout: mon clock drift allowed = 1.000 2020-02-12T14:11:41.451 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:41.451 INFO:teuthology.orchestra.run.smithi072.stdout: osd crush chooseleaf type = 0 2020-02-12T14:11:41.451 INFO:teuthology.orchestra.run.smithi072.stdout: auth debug = true 2020-02-12T14:11:41.452 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:41.452 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on old message = true 2020-02-12T14:11:41.452 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on bug = true 2020-02-12T14:11:41.452 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:41.452 INFO:teuthology.orchestra.run.smithi072.stdout: mon max pg per osd = 10000 # >= luminous 2020-02-12T14:11:41.452 INFO:teuthology.orchestra.run.smithi072.stdout: mon pg warn max object skew = 0 2020-02-12T14:11:41.452 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:41.452 INFO:teuthology.orchestra.run.smithi072.stdout: # disable pg_autoscaler by default for new pools 2020-02-12T14:11:41.453 INFO:teuthology.orchestra.run.smithi072.stdout: osd_pool_default_pg_autoscale_mode = off 2020-02-12T14:11:41.453 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:41.453 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default size = 2 2020-02-12T14:11:41.453 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:41.453 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow primary affinity = true 2020-02-12T14:11:41.453 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow pg remap = true 2020-02-12T14:11:41.453 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on legacy crush tunables = false 2020-02-12T14:11:41.454 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on crush straw calc version zero = false 2020-02-12T14:11:41.454 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on no sortbitwise = false 2020-02-12T14:11:41.454 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on osd down out interval zero = false 2020-02-12T14:11:41.454 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on too few osds = false 2020-02-12T14:11:41.454 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-02-12T14:11:41.454 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_no_redundancy = false 2020-02-12T14:11:41.454 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:41.454 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-02-12T14:11:41.455 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:41.455 INFO:teuthology.orchestra.run.smithi072.stdout: osd default data pool replay window = 5 2020-02-12T14:11:41.455 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:41.455 INFO:teuthology.orchestra.run.smithi072.stdout: mon allow pool delete = true 2020-02-12T14:11:41.455 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:41.455 INFO:teuthology.orchestra.run.smithi072.stdout: mon cluster log file level = debug 2020-02-12T14:11:41.455 INFO:teuthology.orchestra.run.smithi072.stdout: debug asserts on shutdown = true 2020-02-12T14:11:41.456 INFO:teuthology.orchestra.run.smithi072.stdout: mon host = "172.21.15.139,[v2:172.21.15.72:3301,v1:172.21.15.72:6790],172.21.15.72" 2020-02-12T14:11:41.456 INFO:teuthology.orchestra.run.smithi072.stdout: fsid = dacc9a6c-9e88-46ac-940b-c4a329dbffec 2020-02-12T14:11:41.456 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:41.456 INFO:teuthology.orchestra.run.smithi072.stdout:[osd] 2020-02-12T14:11:41.456 INFO:teuthology.orchestra.run.smithi072.stdout: osd journal size = 100 2020-02-12T14:11:41.456 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:41.456 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub load threshold = 5.0 2020-02-12T14:11:41.456 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub max interval = 600 2020-02-12T14:11:41.457 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:41.457 INFO:teuthology.orchestra.run.smithi072.stdout: osd recover clone overlap = true 2020-02-12T14:11:41.457 INFO:teuthology.orchestra.run.smithi072.stdout: osd recovery max chunk = 1048576 2020-02-12T14:11:41.457 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:41.457 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug shutdown = true 2020-02-12T14:11:41.457 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug op order = true 2020-02-12T14:11:41.457 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug verify stray on activate = true 2020-02-12T14:11:41.458 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:41.458 INFO:teuthology.orchestra.run.smithi072.stdout: osd open classes on start = true 2020-02-12T14:11:41.458 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug pg log writeout = true 2020-02-12T14:11:41.458 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:41.458 INFO:teuthology.orchestra.run.smithi072.stdout: osd deep scrub update digest min age = 30 2020-02-12T14:11:41.458 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:41.458 INFO:teuthology.orchestra.run.smithi072.stdout: osd map max advance = 10 2020-02-12T14:11:41.458 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:41.459 INFO:teuthology.orchestra.run.smithi072.stdout: journal zero on create = true 2020-02-12T14:11:41.459 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:41.459 INFO:teuthology.orchestra.run.smithi072.stdout: filestore ondisk finisher threads = 3 2020-02-12T14:11:41.459 INFO:teuthology.orchestra.run.smithi072.stdout: filestore apply finisher threads = 3 2020-02-12T14:11:41.459 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:41.460 INFO:teuthology.orchestra.run.smithi072.stdout: bdev debug aio = true 2020-02-12T14:11:41.460 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug misdirected ops = true 2020-02-12T14:11:41.460 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd full ratio = 0.9 2020-02-12T14:11:41.460 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2020-02-12T14:11:41.461 INFO:teuthology.orchestra.run.smithi072.stdout: debug journal = 20 2020-02-12T14:11:41.461 INFO:teuthology.orchestra.run.smithi072.stdout: debug osd = 25 2020-02-12T14:11:41.461 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluestore = 20 2020-02-12T14:11:41.461 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluefs = 20 2020-02-12T14:11:41.461 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd backfillfull_ratio = 0.85 2020-02-12T14:11:41.461 INFO:teuthology.orchestra.run.smithi072.stdout: osd_max_omap_entries_per_request = 10000 2020-02-12T14:11:41.461 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore fsck on mount = True 2020-02-12T14:11:41.462 INFO:teuthology.orchestra.run.smithi072.stdout: debug rocksdb = 10 2020-02-12T14:11:41.462 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd nearfull ratio = 0.8 2020-02-12T14:11:41.462 INFO:teuthology.orchestra.run.smithi072.stdout: osd objectstore = bluestore 2020-02-12T14:11:41.462 INFO:teuthology.orchestra.run.smithi072.stdout: osd failsafe full ratio = 0.95 2020-02-12T14:11:41.462 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore block size = 96636764160 2020-02-12T14:11:41.462 INFO:teuthology.orchestra.run.smithi072.stdout: debug filestore = 20 2020-02-12T14:11:41.462 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2020-02-12T14:11:41.462 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:41.463 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr] 2020-02-12T14:11:41.463 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2020-02-12T14:11:41.463 INFO:teuthology.orchestra.run.smithi072.stdout: debug mgr = 20 2020-02-12T14:11:41.463 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2020-02-12T14:11:41.464 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2020-02-12T14:11:41.464 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2020-02-12T14:11:41.464 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2020-02-12T14:11:41.464 INFO:teuthology.orchestra.run.smithi072.stdout: mgr/telemetry/nag = false 2020-02-12T14:11:41.464 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:41.464 INFO:teuthology.orchestra.run.smithi072.stdout:[mon] 2020-02-12T14:11:41.464 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2020-02-12T14:11:41.464 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2020-02-12T14:11:41.465 INFO:teuthology.orchestra.run.smithi072.stdout: debug paxos = 20 2020-02-12T14:11:41.465 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2020-02-12T14:11:41.465 INFO:teuthology.orchestra.run.smithi072.stdout: mon data avail warn = 5 2020-02-12T14:11:41.465 INFO:teuthology.orchestra.run.smithi072.stdout: mon mgr mkfs grace = 240 2020-02-12T14:11:41.465 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2020-02-12T14:11:41.465 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd reporter subtree level = osd 2020-02-12T14:11:41.465 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd prime pg temp = true 2020-02-12T14:11:41.466 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2020-02-12T14:11:41.466 INFO:teuthology.orchestra.run.smithi072.stdout: mon op complaint time = 120 2020-02-12T14:11:41.466 INFO:teuthology.orchestra.run.smithi072.stdout: 2020-02-12T14:11:41.466 INFO:teuthology.orchestra.run.smithi072.stdout:[client] 2020-02-12T14:11:41.466 INFO:teuthology.orchestra.run.smithi072.stdout: rgw cache enabled = true 2020-02-12T14:11:41.466 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable ops log = true 2020-02-12T14:11:41.466 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable usage log = true 2020-02-12T14:11:41.466 INFO:teuthology.orchestra.run.smithi072.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-02-12T14:11:41.467 INFO:teuthology.orchestra.run.smithi072.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-02-12T14:11:41.467 INFO:teuthology.orchestra.run.smithi072.stdout: fuse set user groups = True 2020-02-12T14:11:41.467 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2020-02-12T14:11:41.467 INFO:teuthology.orchestra.run.smithi072.stdout: fuse default permissions = False 2020-02-12T14:11:41.467 INFO:teuthology.orchestra.run.smithi072.stdout: debug client = 20 2020-02-12T14:11:41.467 INFO:teuthology.orchestra.run.smithi072.stdout: client mount timeout = 600 2020-02-12T14:11:41.467 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.a] 2020-02-12T14:11:41.468 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.c] 2020-02-12T14:11:41.468 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.b] 2020-02-12T14:11:41.468 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2020-02-12T14:11:41.468 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2020-02-12T14:11:41.468 INFO:teuthology.orchestra.run.smithi072.stdout:[mds] 2020-02-12T14:11:41.468 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug frag = True 2020-02-12T14:11:41.468 INFO:teuthology.orchestra.run.smithi072.stdout: mds bal split bits = 3 2020-02-12T14:11:41.468 INFO:teuthology.orchestra.run.smithi072.stdout: mds bal split size = 100 2020-02-12T14:11:41.469 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds = 20 2020-02-12T14:11:41.469 INFO:teuthology.orchestra.run.smithi072.stdout: mds bal merge size = 5 2020-02-12T14:11:41.469 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2020-02-12T14:11:41.469 INFO:teuthology.orchestra.run.smithi072.stdout: mds bal frag = True 2020-02-12T14:11:41.469 INFO:teuthology.orchestra.run.smithi072.stdout: mds bal fragment size max = 10000 2020-02-12T14:11:41.469 INFO:teuthology.orchestra.run.smithi072.stdout: mds op complaint time = 180 2020-02-12T14:11:41.469 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug scatterstat = True 2020-02-12T14:11:41.469 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2020-02-12T14:11:41.470 INFO:teuthology.orchestra.run.smithi072.stdout: mds verify scatter = True 2020-02-12T14:11:41.488 INFO:teuthology.orchestra.run.smithi139.stdout:[global] 2020-02-12T14:11:41.488 INFO:teuthology.orchestra.run.smithi139.stdout: chdir = "" 2020-02-12T14:11:41.489 INFO:teuthology.orchestra.run.smithi139.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-02-12T14:11:41.489 INFO:teuthology.orchestra.run.smithi139.stdout: auth supported = cephx 2020-02-12T14:11:41.489 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:41.489 INFO:teuthology.orchestra.run.smithi139.stdout: filestore xattr use omap = true 2020-02-12T14:11:41.489 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:41.489 INFO:teuthology.orchestra.run.smithi139.stdout: mon clock drift allowed = 1.000 2020-02-12T14:11:41.489 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:41.490 INFO:teuthology.orchestra.run.smithi139.stdout: osd crush chooseleaf type = 0 2020-02-12T14:11:41.490 INFO:teuthology.orchestra.run.smithi139.stdout: auth debug = true 2020-02-12T14:11:41.490 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:41.490 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on old message = true 2020-02-12T14:11:41.490 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on bug = true 2020-02-12T14:11:41.490 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:41.490 INFO:teuthology.orchestra.run.smithi139.stdout: mon max pg per osd = 10000 # >= luminous 2020-02-12T14:11:41.490 INFO:teuthology.orchestra.run.smithi139.stdout: mon pg warn max object skew = 0 2020-02-12T14:11:41.491 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:41.491 INFO:teuthology.orchestra.run.smithi139.stdout: # disable pg_autoscaler by default for new pools 2020-02-12T14:11:41.491 INFO:teuthology.orchestra.run.smithi139.stdout: osd_pool_default_pg_autoscale_mode = off 2020-02-12T14:11:41.491 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:41.491 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default size = 2 2020-02-12T14:11:41.491 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:41.491 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow primary affinity = true 2020-02-12T14:11:41.491 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow pg remap = true 2020-02-12T14:11:41.492 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on legacy crush tunables = false 2020-02-12T14:11:41.492 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on crush straw calc version zero = false 2020-02-12T14:11:41.492 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on no sortbitwise = false 2020-02-12T14:11:41.492 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on osd down out interval zero = false 2020-02-12T14:11:41.492 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on too few osds = false 2020-02-12T14:11:41.492 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-02-12T14:11:41.492 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_no_redundancy = false 2020-02-12T14:11:41.492 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:41.493 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-02-12T14:11:41.493 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:41.493 INFO:teuthology.orchestra.run.smithi139.stdout: osd default data pool replay window = 5 2020-02-12T14:11:41.493 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:41.493 INFO:teuthology.orchestra.run.smithi139.stdout: mon allow pool delete = true 2020-02-12T14:11:41.493 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:41.493 INFO:teuthology.orchestra.run.smithi139.stdout: mon cluster log file level = debug 2020-02-12T14:11:41.494 INFO:teuthology.orchestra.run.smithi139.stdout: debug asserts on shutdown = true 2020-02-12T14:11:41.494 INFO:teuthology.orchestra.run.smithi139.stdout: mon host = "172.21.15.139,[v2:172.21.15.72:3301,v1:172.21.15.72:6790],172.21.15.72" 2020-02-12T14:11:41.494 INFO:teuthology.orchestra.run.smithi139.stdout: fsid = dacc9a6c-9e88-46ac-940b-c4a329dbffec 2020-02-12T14:11:41.494 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:41.494 INFO:teuthology.orchestra.run.smithi139.stdout:[osd] 2020-02-12T14:11:41.494 INFO:teuthology.orchestra.run.smithi139.stdout: osd journal size = 100 2020-02-12T14:11:41.494 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:41.494 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub load threshold = 5.0 2020-02-12T14:11:41.495 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub max interval = 600 2020-02-12T14:11:41.495 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:41.495 INFO:teuthology.orchestra.run.smithi139.stdout: osd recover clone overlap = true 2020-02-12T14:11:41.495 INFO:teuthology.orchestra.run.smithi139.stdout: osd recovery max chunk = 1048576 2020-02-12T14:11:41.495 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:41.495 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug shutdown = true 2020-02-12T14:11:41.495 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug op order = true 2020-02-12T14:11:41.495 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug verify stray on activate = true 2020-02-12T14:11:41.496 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:41.496 INFO:teuthology.orchestra.run.smithi139.stdout: osd open classes on start = true 2020-02-12T14:11:41.496 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug pg log writeout = true 2020-02-12T14:11:41.496 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:41.496 INFO:teuthology.orchestra.run.smithi139.stdout: osd deep scrub update digest min age = 30 2020-02-12T14:11:41.496 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:41.496 INFO:teuthology.orchestra.run.smithi139.stdout: osd map max advance = 10 2020-02-12T14:11:41.496 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:41.497 INFO:teuthology.orchestra.run.smithi139.stdout: journal zero on create = true 2020-02-12T14:11:41.497 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:41.497 INFO:teuthology.orchestra.run.smithi139.stdout: filestore ondisk finisher threads = 3 2020-02-12T14:11:41.497 INFO:teuthology.orchestra.run.smithi139.stdout: filestore apply finisher threads = 3 2020-02-12T14:11:41.497 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:41.497 INFO:teuthology.orchestra.run.smithi139.stdout: bdev debug aio = true 2020-02-12T14:11:41.497 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug misdirected ops = true 2020-02-12T14:11:41.498 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd full ratio = 0.9 2020-02-12T14:11:41.498 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2020-02-12T14:11:41.498 INFO:teuthology.orchestra.run.smithi139.stdout: debug journal = 20 2020-02-12T14:11:41.498 INFO:teuthology.orchestra.run.smithi139.stdout: debug osd = 25 2020-02-12T14:11:41.498 INFO:teuthology.orchestra.run.smithi139.stdout: debug bluestore = 20 2020-02-12T14:11:41.498 INFO:teuthology.orchestra.run.smithi139.stdout: debug bluefs = 20 2020-02-12T14:11:41.498 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd backfillfull_ratio = 0.85 2020-02-12T14:11:41.499 INFO:teuthology.orchestra.run.smithi139.stdout: osd_max_omap_entries_per_request = 10000 2020-02-12T14:11:41.499 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore fsck on mount = True 2020-02-12T14:11:41.499 INFO:teuthology.orchestra.run.smithi139.stdout: debug rocksdb = 10 2020-02-12T14:11:41.499 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd nearfull ratio = 0.8 2020-02-12T14:11:41.499 INFO:teuthology.orchestra.run.smithi139.stdout: osd objectstore = bluestore 2020-02-12T14:11:41.499 INFO:teuthology.orchestra.run.smithi139.stdout: osd failsafe full ratio = 0.95 2020-02-12T14:11:41.499 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore block size = 96636764160 2020-02-12T14:11:41.499 INFO:teuthology.orchestra.run.smithi139.stdout: debug filestore = 20 2020-02-12T14:11:41.500 INFO:teuthology.orchestra.run.smithi139.stdout: osd op complaint time = 180 2020-02-12T14:11:41.500 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:41.500 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr] 2020-02-12T14:11:41.500 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2020-02-12T14:11:41.500 INFO:teuthology.orchestra.run.smithi139.stdout: debug mgr = 20 2020-02-12T14:11:41.500 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2020-02-12T14:11:41.500 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2020-02-12T14:11:41.501 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2020-02-12T14:11:41.501 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2020-02-12T14:11:41.501 INFO:teuthology.orchestra.run.smithi139.stdout: mgr/telemetry/nag = false 2020-02-12T14:11:41.501 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:41.501 INFO:teuthology.orchestra.run.smithi139.stdout:[mon] 2020-02-12T14:11:41.501 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2020-02-12T14:11:41.501 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2020-02-12T14:11:41.501 INFO:teuthology.orchestra.run.smithi139.stdout: debug paxos = 20 2020-02-12T14:11:41.502 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2020-02-12T14:11:41.502 INFO:teuthology.orchestra.run.smithi139.stdout: mon data avail warn = 5 2020-02-12T14:11:41.502 INFO:teuthology.orchestra.run.smithi139.stdout: mon mgr mkfs grace = 240 2020-02-12T14:11:41.502 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2020-02-12T14:11:41.502 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd reporter subtree level = osd 2020-02-12T14:11:41.502 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd prime pg temp = true 2020-02-12T14:11:41.502 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2020-02-12T14:11:41.502 INFO:teuthology.orchestra.run.smithi139.stdout: mon op complaint time = 120 2020-02-12T14:11:41.503 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:11:41.503 INFO:teuthology.orchestra.run.smithi139.stdout:[client] 2020-02-12T14:11:41.503 INFO:teuthology.orchestra.run.smithi139.stdout: rgw cache enabled = true 2020-02-12T14:11:41.503 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable ops log = true 2020-02-12T14:11:41.503 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable usage log = true 2020-02-12T14:11:41.503 INFO:teuthology.orchestra.run.smithi139.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-02-12T14:11:41.503 INFO:teuthology.orchestra.run.smithi139.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-02-12T14:11:41.504 INFO:teuthology.orchestra.run.smithi139.stdout: fuse set user groups = True 2020-02-12T14:11:41.504 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2020-02-12T14:11:41.504 INFO:teuthology.orchestra.run.smithi139.stdout: fuse default permissions = False 2020-02-12T14:11:41.504 INFO:teuthology.orchestra.run.smithi139.stdout: debug client = 20 2020-02-12T14:11:41.504 INFO:teuthology.orchestra.run.smithi139.stdout: client mount timeout = 600 2020-02-12T14:11:41.504 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.a] 2020-02-12T14:11:41.505 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.c] 2020-02-12T14:11:41.505 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.b] 2020-02-12T14:11:41.505 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.b] 2020-02-12T14:11:41.505 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.a] 2020-02-12T14:11:41.505 INFO:teuthology.orchestra.run.smithi139.stdout:[mds] 2020-02-12T14:11:41.505 INFO:teuthology.orchestra.run.smithi139.stdout: mds debug frag = True 2020-02-12T14:11:41.506 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal split bits = 3 2020-02-12T14:11:41.506 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal split size = 100 2020-02-12T14:11:41.506 INFO:teuthology.orchestra.run.smithi139.stdout: debug mds = 20 2020-02-12T14:11:41.506 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal merge size = 5 2020-02-12T14:11:41.506 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2020-02-12T14:11:41.506 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal frag = True 2020-02-12T14:11:41.506 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal fragment size max = 10000 2020-02-12T14:11:41.507 INFO:teuthology.orchestra.run.smithi139.stdout: mds op complaint time = 180 2020-02-12T14:11:41.507 INFO:teuthology.orchestra.run.smithi139.stdout: mds debug scatterstat = True 2020-02-12T14:11:41.507 INFO:teuthology.orchestra.run.smithi139.stdout: osd op complaint time = 180 2020-02-12T14:11:41.507 INFO:teuthology.orchestra.run.smithi139.stdout: mds verify scatter = True 2020-02-12T14:11:41.508 INFO:tasks.ceph:Creating admin key on mon.a... 2020-02-12T14:11:41.508 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-02-12T14:11:41.558 INFO:tasks.ceph:Copying monmap to all nodes... 2020-02-12T14:11:41.575 DEBUG:teuthology.orchestra.remote:smithi139:/etc/ceph/ceph.keyring is 206B 2020-02-12T14:11:41.669 DEBUG:teuthology.orchestra.remote:smithi139:/home/ubuntu/cephtest/ceph.monmap is 379B 2020-02-12T14:11:41.716 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi072.front.sepia.ceph.com 2020-02-12T14:11:41.717 INFO:teuthology.orchestra.run.smithi072:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-02-12T14:11:41.776 INFO:teuthology.orchestra.run.smithi072:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-02-12T14:11:41.861 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi139.front.sepia.ceph.com 2020-02-12T14:11:41.861 INFO:teuthology.orchestra.run.smithi139:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-02-12T14:11:41.920 INFO:teuthology.orchestra.run.smithi139:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-02-12T14:11:42.007 INFO:tasks.ceph:Setting up mon nodes... 2020-02-12T14:11:42.007 INFO:tasks.ceph:Setting up mgr nodes... 2020-02-12T14:11:42.007 INFO:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-02-12T14:11:42.090 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-02-12T14:11:42.092 INFO:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-02-12T14:11:42.145 INFO:teuthology.orchestra.run.smithi139.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-02-12T14:11:42.147 INFO:tasks.ceph:Setting up mds nodes... 2020-02-12T14:11:42.147 INFO:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2020-02-12T14:11:42.199 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2020-02-12T14:11:42.202 INFO:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2020-02-12T14:11:42.229 INFO:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2020-02-12T14:11:42.282 INFO:teuthology.orchestra.run.smithi139.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2020-02-12T14:11:42.284 INFO:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2020-02-12T14:11:42.311 INFO:tasks.ceph_client:Setting up client nodes... 2020-02-12T14:11:42.311 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-02-12T14:11:42.390 INFO:teuthology.orchestra.run.smithi139.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-02-12T14:11:42.406 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-02-12T14:11:42.406 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi139.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'}} 2020-02-12T14:11:42.406 INFO:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-02-12T14:11:42.434 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-02-12T14:11:42.434 INFO:tasks.ceph:{} 2020-02-12T14:11:42.434 INFO:tasks.ceph:osd.4 2020-02-12T14:11:42.434 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com 2020-02-12T14:11:42.434 INFO:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-02-12T14:11:42.972 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-02-12T14:11:42.972 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2020-02-12T14:11:42.972 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-02-12T14:11:42.972 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 2020-02-12T14:11:42.973 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-02-12T14:11:42.973 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2020-02-12T14:11:42.973 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-02-12T14:11:42.973 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-02-12T14:11:42.973 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-02-12T14:11:42.973 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-02-12T14:11:42.974 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2020-02-12T14:11:42.974 INFO:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4 2020-02-12T14:11:43.094 INFO:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-02-12T14:11:43.125 INFO:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-02-12T14:11:43.192 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-02-12T14:11:43.192 INFO:tasks.ceph:{} 2020-02-12T14:11:43.192 INFO:tasks.ceph:osd.5 2020-02-12T14:11:43.193 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com 2020-02-12T14:11:43.193 INFO:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-02-12T14:11:43.712 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-02-12T14:11:43.712 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2020-02-12T14:11:43.712 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-02-12T14:11:43.712 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 2020-02-12T14:11:43.712 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-02-12T14:11:43.712 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2020-02-12T14:11:43.712 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-02-12T14:11:43.713 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-02-12T14:11:43.713 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-02-12T14:11:43.713 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-02-12T14:11:43.714 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2020-02-12T14:11:43.714 INFO:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-5 2020-02-12T14:11:43.758 INFO:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-02-12T14:11:43.829 INFO:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-02-12T14:11:43.897 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-02-12T14:11:43.897 INFO:tasks.ceph:{} 2020-02-12T14:11:43.897 INFO:tasks.ceph:osd.6 2020-02-12T14:11:43.897 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com 2020-02-12T14:11:43.897 INFO:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-02-12T14:11:44.440 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-02-12T14:11:44.440 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2020-02-12T14:11:44.440 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-02-12T14:11:44.441 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 2020-02-12T14:11:44.441 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-02-12T14:11:44.441 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2020-02-12T14:11:44.441 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-02-12T14:11:44.441 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-02-12T14:11:44.441 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-02-12T14:11:44.441 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-02-12T14:11:44.442 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2020-02-12T14:11:44.442 INFO:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2020-02-12T14:11:44.514 INFO:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-02-12T14:11:44.544 INFO:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-02-12T14:11:44.612 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-02-12T14:11:44.612 INFO:tasks.ceph:{} 2020-02-12T14:11:44.613 INFO:tasks.ceph:osd.7 2020-02-12T14:11:44.613 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com 2020-02-12T14:11:44.613 INFO:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-02-12T14:11:45.171 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-02-12T14:11:45.171 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2020-02-12T14:11:45.171 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-02-12T14:11:45.171 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 2020-02-12T14:11:45.171 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-02-12T14:11:45.172 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2020-02-12T14:11:45.172 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-02-12T14:11:45.172 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-02-12T14:11:45.172 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-02-12T14:11:45.172 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-02-12T14:11:45.173 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2020-02-12T14:11:45.174 INFO:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2020-02-12T14:11:45.298 INFO:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-02-12T14:11:45.328 INFO:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-02-12T14:11:45.423 INFO:teuthology.orchestra.run.smithi072.stderr:2020-02-12T14:11:45.421+0000 7f14045f0ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-02-12T14:11:45.425 INFO:teuthology.orchestra.run.smithi072.stderr:2020-02-12T14:11:45.423+0000 7f14045f0ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-02-12T14:11:45.426 INFO:teuthology.orchestra.run.smithi072.stderr:2020-02-12T14:11:45.423+0000 7f14045f0ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-02-12T14:11:45.426 INFO:teuthology.orchestra.run.smithi072.stderr:2020-02-12T14:11:45.423+0000 7f14045f0ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-02-12T14:11:45.426 INFO:teuthology.orchestra.run.smithi072.stderr:2020-02-12T14:11:45.423+0000 7f14045f0ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-02-12T14:11:45.433 INFO:teuthology.orchestra.run.smithi072.stderr:2020-02-12T14:11:45.431+0000 7f14045f0ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2020-02-12T14:11:47.768 INFO:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-02-12T14:11:47.800 INFO:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-02-12T14:11:47.888 INFO:teuthology.orchestra.run.smithi072.stderr:2020-02-12T14:11:47.885+0000 7f8b92cb7ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-02-12T14:11:47.888 INFO:teuthology.orchestra.run.smithi072.stderr:2020-02-12T14:11:47.886+0000 7f8b92cb7ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-02-12T14:11:47.888 INFO:teuthology.orchestra.run.smithi072.stderr:2020-02-12T14:11:47.886+0000 7f8b92cb7ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-02-12T14:11:47.888 INFO:teuthology.orchestra.run.smithi072.stderr:2020-02-12T14:11:47.886+0000 7f8b92cb7ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-02-12T14:11:47.888 INFO:teuthology.orchestra.run.smithi072.stderr:2020-02-12T14:11:47.886+0000 7f8b92cb7ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-02-12T14:11:47.889 INFO:teuthology.orchestra.run.smithi072.stderr:2020-02-12T14:11:47.886+0000 7f8b92cb7ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2020-02-12T14:11:50.230 INFO:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-02-12T14:11:50.261 INFO:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-02-12T14:11:50.351 INFO:teuthology.orchestra.run.smithi072.stderr:2020-02-12T14:11:50.348+0000 7f8fa111cec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-02-12T14:11:50.351 INFO:teuthology.orchestra.run.smithi072.stderr:2020-02-12T14:11:50.348+0000 7f8fa111cec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-02-12T14:11:50.351 INFO:teuthology.orchestra.run.smithi072.stderr:2020-02-12T14:11:50.348+0000 7f8fa111cec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-02-12T14:11:50.351 INFO:teuthology.orchestra.run.smithi072.stderr:2020-02-12T14:11:50.348+0000 7f8fa111cec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-02-12T14:11:50.352 INFO:teuthology.orchestra.run.smithi072.stderr:2020-02-12T14:11:50.348+0000 7f8fa111cec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-02-12T14:11:50.352 INFO:teuthology.orchestra.run.smithi072.stderr:2020-02-12T14:11:50.349+0000 7f8fa111cec0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2020-02-12T14:11:52.693 INFO:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-02-12T14:11:52.747 INFO:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-02-12T14:11:52.796 INFO:teuthology.orchestra.run.smithi072.stderr:2020-02-12T14:11:52.794+0000 7fb50e144ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-02-12T14:11:52.796 INFO:teuthology.orchestra.run.smithi072.stderr:2020-02-12T14:11:52.794+0000 7fb50e144ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-02-12T14:11:52.797 INFO:teuthology.orchestra.run.smithi072.stderr:2020-02-12T14:11:52.794+0000 7fb50e144ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-02-12T14:11:52.797 INFO:teuthology.orchestra.run.smithi072.stderr:2020-02-12T14:11:52.794+0000 7fb50e144ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-02-12T14:11:52.797 INFO:teuthology.orchestra.run.smithi072.stderr:2020-02-12T14:11:52.794+0000 7fb50e144ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-02-12T14:11:52.797 INFO:teuthology.orchestra.run.smithi072.stderr:2020-02-12T14:11:52.795+0000 7fb50e144ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2020-02-12T14:11:55.129 INFO:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-02-12T14:11:55.161 INFO:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-02-12T14:11:55.193 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-02-12T14:11:55.193 INFO:tasks.ceph:{} 2020-02-12T14:11:55.193 INFO:tasks.ceph:osd.0 2020-02-12T14:11:55.193 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi139.front.sepia.ceph.com 2020-02-12T14:11:55.194 INFO:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-02-12T14:11:55.727 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-02-12T14:11:55.727 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2020-02-12T14:11:55.727 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-02-12T14:11:55.728 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 2020-02-12T14:11:55.728 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-02-12T14:11:55.728 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2020-02-12T14:11:55.728 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-02-12T14:11:55.728 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-02-12T14:11:55.728 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-02-12T14:11:55.728 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-02-12T14:11:55.729 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2020-02-12T14:11:55.729 INFO:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2020-02-12T14:11:55.861 INFO:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-02-12T14:11:55.895 INFO:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-02-12T14:11:55.963 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-02-12T14:11:55.963 INFO:tasks.ceph:{} 2020-02-12T14:11:55.963 INFO:tasks.ceph:osd.1 2020-02-12T14:11:55.964 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi139.front.sepia.ceph.com 2020-02-12T14:11:55.964 INFO:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-02-12T14:11:56.480 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-02-12T14:11:56.480 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2020-02-12T14:11:56.481 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-02-12T14:11:56.481 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 2020-02-12T14:11:56.481 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-02-12T14:11:56.481 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2020-02-12T14:11:56.481 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-02-12T14:11:56.481 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-02-12T14:11:56.481 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-02-12T14:11:56.481 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-02-12T14:11:56.482 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2020-02-12T14:11:56.483 INFO:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2020-02-12T14:11:56.527 INFO:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-02-12T14:11:56.559 INFO:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-02-12T14:11:56.626 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-02-12T14:11:56.626 INFO:tasks.ceph:{} 2020-02-12T14:11:56.627 INFO:tasks.ceph:osd.2 2020-02-12T14:11:56.627 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi139.front.sepia.ceph.com 2020-02-12T14:11:56.627 INFO:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-02-12T14:11:57.174 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-02-12T14:11:57.174 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2020-02-12T14:11:57.174 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-02-12T14:11:57.174 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 2020-02-12T14:11:57.175 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-02-12T14:11:57.175 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2020-02-12T14:11:57.175 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-02-12T14:11:57.175 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-02-12T14:11:57.175 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-02-12T14:11:57.175 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-02-12T14:11:57.176 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2020-02-12T14:11:57.177 INFO:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2020-02-12T14:11:57.254 INFO:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-02-12T14:11:57.289 INFO:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-02-12T14:11:57.356 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-02-12T14:11:57.356 INFO:tasks.ceph:{} 2020-02-12T14:11:57.356 INFO:tasks.ceph:osd.3 2020-02-12T14:11:57.356 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi139.front.sepia.ceph.com 2020-02-12T14:11:57.356 INFO:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-02-12T14:11:57.904 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-02-12T14:11:57.905 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2020-02-12T14:11:57.905 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-02-12T14:11:57.905 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 2020-02-12T14:11:57.905 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-02-12T14:11:57.906 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2020-02-12T14:11:57.906 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-02-12T14:11:57.906 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-02-12T14:11:57.906 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-02-12T14:11:57.906 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-02-12T14:11:57.907 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2020-02-12T14:11:57.908 INFO:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2020-02-12T14:11:58.003 INFO:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-02-12T14:11:58.036 INFO:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-02-12T14:11:58.174 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:11:58.172+0000 7f028c0a9ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-02-12T14:11:58.178 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:11:58.175+0000 7f028c0a9ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-02-12T14:11:58.178 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:11:58.175+0000 7f028c0a9ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-02-12T14:11:58.178 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:11:58.175+0000 7f028c0a9ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-02-12T14:11:58.178 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:11:58.176+0000 7f028c0a9ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-02-12T14:11:58.179 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:11:58.176+0000 7f028c0a9ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-02-12T14:12:00.520 INFO:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-02-12T14:12:00.551 INFO:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-02-12T14:12:00.638 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:00.635+0000 7f016e1efec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-02-12T14:12:00.638 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:00.636+0000 7f016e1efec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-02-12T14:12:00.638 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:00.636+0000 7f016e1efec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-02-12T14:12:00.638 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:00.636+0000 7f016e1efec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-02-12T14:12:00.639 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:00.636+0000 7f016e1efec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-02-12T14:12:00.639 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:00.636+0000 7f016e1efec0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-02-12T14:12:02.972 INFO:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-02-12T14:12:03.004 INFO:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-02-12T14:12:03.091 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:03.090+0000 7f3266381ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-02-12T14:12:03.092 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:03.090+0000 7f3266381ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-02-12T14:12:03.092 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:03.090+0000 7f3266381ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-02-12T14:12:03.092 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:03.090+0000 7f3266381ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-02-12T14:12:03.092 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:03.090+0000 7f3266381ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-02-12T14:12:03.092 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:03.091+0000 7f3266381ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-02-12T14:12:05.436 INFO:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-02-12T14:12:05.468 INFO:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-02-12T14:12:05.556 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:05.555+0000 7f7bcaeb3ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-02-12T14:12:05.556 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:05.555+0000 7f7bcaeb3ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-02-12T14:12:05.557 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:05.555+0000 7f7bcaeb3ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-02-12T14:12:05.557 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:05.555+0000 7f7bcaeb3ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-02-12T14:12:05.557 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:05.555+0000 7f7bcaeb3ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-02-12T14:12:05.557 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:05.556+0000 7f7bcaeb3ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-02-12T14:12:07.890 INFO:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-02-12T14:12:07.922 INFO:tasks.ceph:Reading keys from all nodes... 2020-02-12T14:12:07.923 INFO:teuthology.orchestra.run.smithi072:> mktemp 2020-02-12T14:12:07.940 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.ibFzNS4JuK 2020-02-12T14:12:07.940 INFO:teuthology.orchestra.run.smithi072:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.ibFzNS4JuK 2020-02-12T14:12:08.012 INFO:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.ibFzNS4JuK 2020-02-12T14:12:08.142 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.ibFzNS4JuK is 56B 2020-02-12T14:12:08.190 INFO:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.ibFzNS4JuK 2020-02-12T14:12:08.205 INFO:teuthology.orchestra.run.smithi072:> mktemp 2020-02-12T14:12:08.259 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.snXdGtW1fc 2020-02-12T14:12:08.260 INFO:teuthology.orchestra.run.smithi072:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.snXdGtW1fc 2020-02-12T14:12:08.330 INFO:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.snXdGtW1fc 2020-02-12T14:12:08.455 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.snXdGtW1fc is 56B 2020-02-12T14:12:08.504 INFO:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.snXdGtW1fc 2020-02-12T14:12:08.517 INFO:teuthology.orchestra.run.smithi072:> mktemp 2020-02-12T14:12:08.571 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.HyC2ntvoYA 2020-02-12T14:12:08.571 INFO:teuthology.orchestra.run.smithi072:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.HyC2ntvoYA 2020-02-12T14:12:08.638 INFO:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.HyC2ntvoYA 2020-02-12T14:12:08.761 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.HyC2ntvoYA is 56B 2020-02-12T14:12:08.809 INFO:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.HyC2ntvoYA 2020-02-12T14:12:08.823 INFO:teuthology.orchestra.run.smithi072:> mktemp 2020-02-12T14:12:08.877 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.zPMtjSstMr 2020-02-12T14:12:08.877 INFO:teuthology.orchestra.run.smithi072:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.zPMtjSstMr 2020-02-12T14:12:08.944 INFO:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.zPMtjSstMr 2020-02-12T14:12:09.067 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.zPMtjSstMr is 56B 2020-02-12T14:12:09.116 INFO:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.zPMtjSstMr 2020-02-12T14:12:09.129 INFO:teuthology.orchestra.run.smithi072:> mktemp 2020-02-12T14:12:09.182 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.LAGQRrdV65 2020-02-12T14:12:09.182 INFO:teuthology.orchestra.run.smithi072:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.LAGQRrdV65 2020-02-12T14:12:09.249 INFO:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.LAGQRrdV65 2020-02-12T14:12:09.371 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.LAGQRrdV65 is 56B 2020-02-12T14:12:09.419 INFO:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.LAGQRrdV65 2020-02-12T14:12:09.433 INFO:teuthology.orchestra.run.smithi072:> mktemp 2020-02-12T14:12:09.487 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.o7Bh9LrIbc 2020-02-12T14:12:09.487 INFO:teuthology.orchestra.run.smithi072:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.o7Bh9LrIbc 2020-02-12T14:12:09.554 INFO:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.o7Bh9LrIbc 2020-02-12T14:12:09.678 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.o7Bh9LrIbc is 56B 2020-02-12T14:12:09.727 INFO:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.o7Bh9LrIbc 2020-02-12T14:12:09.740 INFO:teuthology.orchestra.run.smithi139:> mktemp 2020-02-12T14:12:09.757 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.0rHBteuE8W 2020-02-12T14:12:09.758 INFO:teuthology.orchestra.run.smithi139:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.0rHBteuE8W 2020-02-12T14:12:09.830 INFO:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.0rHBteuE8W 2020-02-12T14:12:09.960 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.0rHBteuE8W is 56B 2020-02-12T14:12:10.009 INFO:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.0rHBteuE8W 2020-02-12T14:12:10.025 INFO:teuthology.orchestra.run.smithi139:> mktemp 2020-02-12T14:12:10.080 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.Ksh9FIPmIH 2020-02-12T14:12:10.080 INFO:teuthology.orchestra.run.smithi139:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.Ksh9FIPmIH 2020-02-12T14:12:10.149 INFO:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.Ksh9FIPmIH 2020-02-12T14:12:10.276 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.Ksh9FIPmIH is 56B 2020-02-12T14:12:10.325 INFO:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.Ksh9FIPmIH 2020-02-12T14:12:10.340 INFO:teuthology.orchestra.run.smithi139:> mktemp 2020-02-12T14:12:10.342 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:12:10.345 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:12:10.394 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.II9CpWOFgQ 2020-02-12T14:12:10.395 INFO:teuthology.orchestra.run.smithi139:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.II9CpWOFgQ 2020-02-12T14:12:10.461 INFO:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.II9CpWOFgQ 2020-02-12T14:12:10.594 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.II9CpWOFgQ is 56B 2020-02-12T14:12:10.612 INFO:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.II9CpWOFgQ 2020-02-12T14:12:10.626 INFO:teuthology.orchestra.run.smithi139:> mktemp 2020-02-12T14:12:10.679 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.U7x7eaOBOL 2020-02-12T14:12:10.679 INFO:teuthology.orchestra.run.smithi139:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.U7x7eaOBOL 2020-02-12T14:12:10.746 INFO:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.U7x7eaOBOL 2020-02-12T14:12:10.868 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.U7x7eaOBOL is 56B 2020-02-12T14:12:10.918 INFO:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.U7x7eaOBOL 2020-02-12T14:12:10.931 INFO:teuthology.orchestra.run.smithi139:> mktemp 2020-02-12T14:12:10.985 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.dxoPtvKImq 2020-02-12T14:12:10.985 INFO:teuthology.orchestra.run.smithi139:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.dxoPtvKImq 2020-02-12T14:12:11.052 INFO:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.dxoPtvKImq 2020-02-12T14:12:11.175 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.dxoPtvKImq is 56B 2020-02-12T14:12:11.223 INFO:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.dxoPtvKImq 2020-02-12T14:12:11.238 INFO:teuthology.orchestra.run.smithi139:> mktemp 2020-02-12T14:12:11.291 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.lZoQVY5LCf 2020-02-12T14:12:11.291 INFO:teuthology.orchestra.run.smithi139:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.lZoQVY5LCf 2020-02-12T14:12:11.358 INFO:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.lZoQVY5LCf 2020-02-12T14:12:11.481 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.lZoQVY5LCf is 56B 2020-02-12T14:12:11.529 INFO:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.lZoQVY5LCf 2020-02-12T14:12:11.599 DEBUG:teuthology.orchestra.remote:smithi139:/etc/ceph/ceph.client.0.keyring is 59B 2020-02-12T14:12:11.649 INFO:tasks.ceph:Adding keys to all mons... 2020-02-12T14:12:11.649 INFO:teuthology.orchestra.run.smithi072:> sudo tee -a /etc/ceph/ceph.keyring 2020-02-12T14:12:11.651 INFO:teuthology.orchestra.run.smithi139:> sudo tee -a /etc/ceph/ceph.keyring 2020-02-12T14:12:11.679 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.x] 2020-02-12T14:12:11.679 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCeB0Rel25eBRAAgGmoa4p6fNnPSYXfRWSoxg== 2020-02-12T14:12:11.679 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2020-02-12T14:12:11.679 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCeB0ReK8zfCxAA88qrOm3eaT/s+kC7phIwPw== 2020-02-12T14:12:11.680 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.4] 2020-02-12T14:12:11.680 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQChB0Re1zM7GRAA58/bmZU+hECe1ZmpjP3KOA== 2020-02-12T14:12:11.680 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.5] 2020-02-12T14:12:11.680 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCjB0ReWFPhNBAAjCV2m/2Zm49hbbOMyVzyJw== 2020-02-12T14:12:11.680 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.6] 2020-02-12T14:12:11.680 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCmB0Rez3DcFBAAqUb75Bqwkxu/DSgFx5+VXw== 2020-02-12T14:12:11.680 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.7] 2020-02-12T14:12:11.681 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCoB0ReMXZxLxAAdI3NgtcYUPiTpYeaSi1s4w== 2020-02-12T14:12:11.681 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.y] 2020-02-12T14:12:11.681 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCeB0ReJAmjCBAA6Id7JnHBDNirrq3Bnyqllg== 2020-02-12T14:12:11.681 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2020-02-12T14:12:11.681 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCeB0ReJwnPEBAA4bxDuLY9tU7vIU/Y1qfJZA== 2020-02-12T14:12:11.681 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.0] 2020-02-12T14:12:11.681 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCuB0Re9+JcChAAEgMQxRe7JqfLx2PWVK3bzQ== 2020-02-12T14:12:11.682 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.1] 2020-02-12T14:12:11.682 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCwB0ReMCb+JRAAnZOq2lU+QaCXy5Ig/a4/pw== 2020-02-12T14:12:11.682 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.2] 2020-02-12T14:12:11.682 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCzB0RenuhrBRAA5bitpmHpIkUS1jo/21IzzQ== 2020-02-12T14:12:11.682 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.3] 2020-02-12T14:12:11.682 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQC1B0Re4wghIRAAs1tDqLq5ckVtcraD/Xe0vQ== 2020-02-12T14:12:11.682 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2020-02-12T14:12:11.682 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCeB0Re9JI5FxAA6e24so50TfCoGm1/baKqAQ== 2020-02-12T14:12:11.695 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr.x] 2020-02-12T14:12:11.695 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQCeB0Rel25eBRAAgGmoa4p6fNnPSYXfRWSoxg== 2020-02-12T14:12:11.695 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.b] 2020-02-12T14:12:11.695 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQCeB0ReK8zfCxAA88qrOm3eaT/s+kC7phIwPw== 2020-02-12T14:12:11.695 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.4] 2020-02-12T14:12:11.696 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQChB0Re1zM7GRAA58/bmZU+hECe1ZmpjP3KOA== 2020-02-12T14:12:11.696 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.5] 2020-02-12T14:12:11.696 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQCjB0ReWFPhNBAAjCV2m/2Zm49hbbOMyVzyJw== 2020-02-12T14:12:11.696 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.6] 2020-02-12T14:12:11.696 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQCmB0Rez3DcFBAAqUb75Bqwkxu/DSgFx5+VXw== 2020-02-12T14:12:11.696 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.7] 2020-02-12T14:12:11.696 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQCoB0ReMXZxLxAAdI3NgtcYUPiTpYeaSi1s4w== 2020-02-12T14:12:11.697 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr.y] 2020-02-12T14:12:11.697 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQCeB0ReJAmjCBAA6Id7JnHBDNirrq3Bnyqllg== 2020-02-12T14:12:11.697 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.a] 2020-02-12T14:12:11.697 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQCeB0ReJwnPEBAA4bxDuLY9tU7vIU/Y1qfJZA== 2020-02-12T14:12:11.697 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.0] 2020-02-12T14:12:11.697 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQCuB0Re9+JcChAAEgMQxRe7JqfLx2PWVK3bzQ== 2020-02-12T14:12:11.697 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.1] 2020-02-12T14:12:11.698 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQCwB0ReMCb+JRAAnZOq2lU+QaCXy5Ig/a4/pw== 2020-02-12T14:12:11.698 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.2] 2020-02-12T14:12:11.698 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQCzB0RenuhrBRAA5bitpmHpIkUS1jo/21IzzQ== 2020-02-12T14:12:11.698 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.3] 2020-02-12T14:12:11.698 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQC1B0Re4wghIRAAs1tDqLq5ckVtcraD/Xe0vQ== 2020-02-12T14:12:11.699 INFO:teuthology.orchestra.run.smithi139.stdout:[client.0] 2020-02-12T14:12:11.699 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQCeB0Re9JI5FxAA6e24so50TfCoGm1/baKqAQ== 2020-02-12T14:12:11.700 INFO:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-02-12T14:12:11.726 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-02-12T14:12:11.787 INFO:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-02-12T14:12:11.789 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-02-12T14:12:11.839 INFO:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T14:12:11.842 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T14:12:11.889 INFO:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T14:12:11.891 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T14:12:11.938 INFO:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T14:12:11.941 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T14:12:11.988 INFO:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T14:12:11.991 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T14:12:12.039 INFO:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-02-12T14:12:12.041 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-02-12T14:12:12.089 INFO:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-02-12T14:12:12.092 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-02-12T14:12:12.142 INFO:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T14:12:12.144 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T14:12:12.191 INFO:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T14:12:12.193 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T14:12:12.241 INFO:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T14:12:12.243 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T14:12:12.290 INFO:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T14:12:12.293 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T14:12:12.340 INFO:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-02-12T14:12:12.343 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-02-12T14:12:12.392 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-02-12T14:12:12.393 INFO:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-02-12T14:12:12.420 INFO:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-02-12T14:12:12.515 INFO:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-02-12T14:12:12.542 INFO:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-02-12T14:12:12.608 INFO:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-02-12T14:12:12.701 INFO:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-02-12T14:12:12.728 INFO:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-02-12T14:12:12.756 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-02-12T14:12:12.852 INFO:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-02-12T14:12:12.878 INFO:teuthology.orchestra.run.smithi072:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-02-12T14:12:12.881 INFO:teuthology.orchestra.run.smithi139:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-02-12T14:12:12.933 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-02-12T14:12:12.933 INFO:tasks.ceph.mon.b:Restarting daemon 2020-02-12T14:12:12.934 INFO:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-02-12T14:12:12.936 INFO:tasks.ceph.mon.b:Started 2020-02-12T14:12:12.936 INFO:tasks.ceph.mon.c:Restarting daemon 2020-02-12T14:12:12.936 INFO:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-02-12T14:12:12.938 INFO:tasks.ceph.mon.c:Started 2020-02-12T14:12:12.939 INFO:tasks.ceph.mon.a:Restarting daemon 2020-02-12T14:12:12.939 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-02-12T14:12:12.975 INFO:tasks.ceph.mon.a:Started 2020-02-12T14:12:12.975 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-02-12T14:12:12.975 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-02-12T14:12:12.976 INFO:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-02-12T14:12:12.978 INFO:tasks.ceph.mgr.x:Started 2020-02-12T14:12:12.978 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-02-12T14:12:12.978 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-02-12T14:12:12.980 INFO:tasks.ceph.mgr.y:Started 2020-02-12T14:12:12.980 INFO:tasks.ceph:Setting crush tunables to default 2020-02-12T14:12:12.981 INFO:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd crush tunables default 2020-02-12T14:12:18.284 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:13.089+0000 7fd2682ad700 1 Processor -- start 2020-02-12T14:12:18.285 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:13.089+0000 7fd2682ad700 1 -- start start 2020-02-12T14:12:18.285 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:13.089+0000 7fd2682ad700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 0x7fd2600a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:18.285 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:13.090+0000 7fd2682ad700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd26009a700 con 0x7fd2600a4140 2020-02-12T14:12:18.285 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:13.090+0000 7fd2682ad700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2600a5520 con 0x7fd26007fc00 2020-02-12T14:12:18.285 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:13.090+0000 7fd2682ad700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2600a57c0 con 0x7fd2600a6d90 2020-02-12T14:12:18.285 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:13.090+0000 7fd266049700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fd26007fc00 0x7fd26014c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:34626/0 (socket says 172.21.15.139:34626) 2020-02-12T14:12:18.286 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:13.090+0000 7fd266049700 1 -- 172.21.15.139:0/2012632655 learned_addr learned my addr 172.21.15.139:0/2012632655 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:18.286 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:13.090+0000 7fd26704b700 1 --2- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 0x7fd2600a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:18.286 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:13.090+0000 7fd26704b700 1 -- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 msgr2=0x7fd2600a4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-12T14:12:18.286 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:13.090+0000 7fd26704b700 1 -- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 msgr2=0x7fd2600a4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-12T14:12:18.286 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:13.090+0000 7fd26704b700 1 --2- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 0x7fd2600a4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-12T14:12:18.286 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:13.090+0000 7fd26704b700 1 --2- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 0x7fd2600a4fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-12T14:12:18.286 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:13.291+0000 7fd26704b700 1 --2- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 0x7fd2600a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:18.287 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:13.291+0000 7fd26704b700 1 -- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 msgr2=0x7fd2600a4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-12T14:12:18.287 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:13.291+0000 7fd26704b700 1 -- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 msgr2=0x7fd2600a4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-12T14:12:18.287 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:13.291+0000 7fd26704b700 1 --2- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 0x7fd2600a4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-12T14:12:18.287 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:13.291+0000 7fd26704b700 1 --2- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 0x7fd2600a4fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-12T14:12:18.287 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:13.692+0000 7fd26704b700 1 --2- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 0x7fd2600a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:18.287 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:13.692+0000 7fd26704b700 1 -- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 msgr2=0x7fd2600a4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-12T14:12:18.287 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:13.692+0000 7fd26704b700 1 -- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 msgr2=0x7fd2600a4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-12T14:12:18.287 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:13.692+0000 7fd26704b700 1 --2- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 0x7fd2600a4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-12T14:12:18.288 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:13.692+0000 7fd26704b700 1 --2- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 0x7fd2600a4fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-12T14:12:18.288 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:14.493+0000 7fd26704b700 1 --2- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 0x7fd2600a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:18.288 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:14.494+0000 7fd26704b700 1 -- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 msgr2=0x7fd2600a4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-12T14:12:18.288 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:14.494+0000 7fd26704b700 1 -- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 msgr2=0x7fd2600a4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-12T14:12:18.288 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:14.494+0000 7fd26704b700 1 --2- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 0x7fd2600a4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-12T14:12:18.288 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:14.494+0000 7fd26704b700 1 --2- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 0x7fd2600a4fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-12T14:12:18.288 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:16.096+0000 7fd26704b700 1 --2- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 0x7fd2600a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:18.289 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:16.096+0000 7fd26704b700 1 -- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 msgr2=0x7fd2600a4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-12T14:12:18.289 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:16.096+0000 7fd26704b700 1 -- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 msgr2=0x7fd2600a4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-12T14:12:18.289 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:16.096+0000 7fd26704b700 1 --2- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 0x7fd2600a4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-12T14:12:18.289 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:16.096+0000 7fd26704b700 1 --2- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 0x7fd2600a4fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-12T14:12:18.289 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.276+0000 7fd265848700 1 -- 172.21.15.139:0/2012632655 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311542549 0 0) 0x7fd26009a700 con 0x7fd2600a4140 2020-02-12T14:12:18.289 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.276+0000 7fd265848700 1 -- 172.21.15.139:0/2012632655 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd24c003230 con 0x7fd2600a4140 2020-02-12T14:12:18.289 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.276+0000 7fd265848700 1 -- 172.21.15.139:0/2012632655 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096455694 0 0) 0x7fd2600a5520 con 0x7fd26007fc00 2020-02-12T14:12:18.290 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.276+0000 7fd265848700 1 -- 172.21.15.139:0/2012632655 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd26009a700 con 0x7fd26007fc00 2020-02-12T14:12:18.290 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.276+0000 7fd265848700 1 -- 172.21.15.139:0/2012632655 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3152276913 0 0) 0x7fd26009a700 con 0x7fd26007fc00 2020-02-12T14:12:18.290 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.276+0000 7fd265848700 1 -- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 msgr2=0x7fd2600a4fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-12T14:12:18.290 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.276+0000 7fd265848700 1 --2- 172.21.15.139:0/2012632655 >> v2:172.21.15.72:3300/0 conn(0x7fd2600a6d90 0x7fd2600a4fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:18.290 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.276+0000 7fd265848700 1 -- 172.21.15.139:0/2012632655 >> v1:172.21.15.72:6789/0 conn(0x7fd2600a4140 legacy=0x7fd2600a6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:18.290 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.276+0000 7fd265848700 1 -- 172.21.15.139:0/2012632655 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2601520d0 con 0x7fd26007fc00 2020-02-12T14:12:18.290 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.276+0000 7fd265848700 1 -- 172.21.15.139:0/2012632655 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7fd25c001710 con 0x7fd26007fc00 2020-02-12T14:12:18.290 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.276+0000 7fd265848700 1 -- 172.21.15.139:0/2012632655 >> v1:172.21.15.139:6789/0 conn(0x7fd26007fc00 legacy=0x7fd26014c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:18.291 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.276+0000 7fd265848700 1 --2- 172.21.15.139:0/2012632655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd24c0038b0 0x7fd24c003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:18.291 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.277+0000 7fd265848700 1 --2- 172.21.15.139:0/2012632655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd24c0044d0 0x7fd24c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:18.291 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.277+0000 7fd265848700 1 --2- 172.21.15.139:0/2012632655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd24c004db0 0x7fd24c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:18.291 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.277+0000 7fd265848700 1 -- 172.21.15.139:0/2012632655 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2600a57c0 con 0x7fd24c004db0 2020-02-12T14:12:18.291 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.277+0000 7fd265848700 1 -- 172.21.15.139:0/2012632655 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0053a0 con 0x7fd24c0044d0 2020-02-12T14:12:18.291 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.277+0000 7fd265848700 1 -- 172.21.15.139:0/2012632655 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c00bc00 con 0x7fd24c0038b0 2020-02-12T14:12:18.291 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.277+0000 7fd266049700 1 --2- 172.21.15.139:0/2012632655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd24c0044d0 0x7fd24c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:18.292 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.277+0000 7fd26704b700 1 --2- 172.21.15.139:0/2012632655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd24c004db0 0x7fd24c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:18.292 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.277+0000 7fd26684a700 1 --2- 172.21.15.139:0/2012632655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd24c0038b0 0x7fd24c003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:18.292 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.277+0000 7fd266049700 1 -- 172.21.15.139:0/2012632655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd24c0038b0 msgr2=0x7fd24c003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:18.292 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.277+0000 7fd266049700 1 --2- 172.21.15.139:0/2012632655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd24c0038b0 0x7fd24c003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:18.292 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.277+0000 7fd266049700 1 -- 172.21.15.139:0/2012632655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd24c004db0 msgr2=0x7fd24c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:18.292 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.277+0000 7fd266049700 1 --2- 172.21.15.139:0/2012632655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd24c004db0 0x7fd24c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:18.292 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.277+0000 7fd266049700 1 -- 172.21.15.139:0/2012632655 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26009a700 con 0x7fd24c0044d0 2020-02-12T14:12:18.293 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.277+0000 7fd26704b700 1 -- 172.21.15.139:0/2012632655 reap_dead start 2020-02-12T14:12:18.293 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.277+0000 7fd266049700 1 --2- 172.21.15.139:0/2012632655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd24c0044d0 0x7fd24c004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd25c0014e0 tx=0x7fd2600a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:18.293 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.277+0000 7fd266049700 1 --2- 172.21.15.139:0/2012632655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd24c0044d0 0x7fd24c004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd25c0014e0 tx=0x7fd2600a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:18.293 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.277+0000 7fd266049700 1 --2- 172.21.15.139:0/2012632655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd24c0044d0 0x7fd24c004950 secure :-1 s=READY pgs=8 cs=0 l=1 rx=0x7fd25c0014e0 tx=0x7fd2600a4520).ready entity=mon.1 client_cookie=e6b9ec22559766a1 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:18.293 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.278+0000 7fd266049700 1 --2- 172.21.15.139:0/2012632655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd24c0044d0 0x7fd24c004950 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fd25c0014e0 tx=0x7fd2600a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:18.293 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.278+0000 7fd265848700 1 -- 172.21.15.139:0/2012632655 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd25c00ee90 con 0x7fd24c0044d0 2020-02-12T14:12:18.293 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.278+0000 7fd266049700 1 --2- 172.21.15.139:0/2012632655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd24c0044d0 0x7fd24c004950 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fd25c0014e0 tx=0x7fd2600a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:18.294 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.278+0000 7fd266049700 1 --2- 172.21.15.139:0/2012632655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd24c0044d0 0x7fd24c004950 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fd25c0014e0 tx=0x7fd2600a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:18.294 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.278+0000 7fd265848700 1 -- 172.21.15.139:0/2012632655 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25c010cf0 con 0x7fd24c0044d0 2020-02-12T14:12:18.294 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.278+0000 7fd265848700 1 -- 172.21.15.139:0/2012632655 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd25c010e60 con 0x7fd24c0044d0 2020-02-12T14:12:18.294 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.278+0000 7fd2682ad700 1 -- 172.21.15.139:0/2012632655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd24c0044d0 msgr2=0x7fd24c004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:18.294 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.278+0000 7fd2682ad700 1 --2- 172.21.15.139:0/2012632655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd24c0044d0 0x7fd24c004950 secure :-1 s=READY pgs=8 cs=0 l=1 rx=0x7fd25c0014e0 tx=0x7fd2600a4520).stop 2020-02-12T14:12:18.294 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.279+0000 7fd2682ad700 1 -- 172.21.15.139:0/2012632655 shutdown_connections 2020-02-12T14:12:18.294 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.279+0000 7fd2682ad700 1 --2- 172.21.15.139:0/2012632655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd24c0044d0 0x7fd24c004950 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:18.295 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.279+0000 7fd2682ad700 1 -- 172.21.15.139:0/2012632655 >> 172.21.15.139:0/2012632655 conn(0x7fd26005a720 msgr2=0x7fd26005ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:18.295 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.279+0000 7fd2682ad700 1 -- 172.21.15.139:0/2012632655 shutdown_connections 2020-02-12T14:12:18.295 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.279+0000 7fd2682ad700 1 -- 172.21.15.139:0/2012632655 wait complete. 2020-02-12T14:12:18.295 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.280+0000 7fd2682ad700 1 Processor -- start 2020-02-12T14:12:18.295 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.281+0000 7fd2682ad700 1 -- start start 2020-02-12T14:12:18.295 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.281+0000 7fd2682ad700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd24c0044d0 0x7fd2600a0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:18.295 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.281+0000 7fd2682ad700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd26012c210 0x7fd26009e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:18.296 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.281+0000 7fd2682ad700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2600a77f0 con 0x7fd26009e650 2020-02-12T14:12:18.296 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.281+0000 7fd2682ad700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd26009eb00 con 0x7fd24c0044d0 2020-02-12T14:12:18.296 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.281+0000 7fd2682ad700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2600a1120 con 0x7fd26012c210 2020-02-12T14:12:18.296 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.282+0000 7fd266049700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd26012c210 0x7fd26009e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:18.296 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.282+0000 7fd26704b700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fd26009e650 0x7fd26007e590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:34668/0 (socket says 172.21.15.139:34668) 2020-02-12T14:12:18.296 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.282+0000 7fd26704b700 1 -- 172.21.15.139:0/278202264 learned_addr learned my addr 172.21.15.139:0/278202264 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:18.297 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.282+0000 7fd26684a700 1 --2- 172.21.15.139:0/278202264 >> v2:172.21.15.139:3300/0 conn(0x7fd24c0044d0 0x7fd2600a0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:18.297 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.282+0000 7fd26684a700 1 -- 172.21.15.139:0/278202264 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd26012c210 msgr2=0x7fd26009e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:18.297 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.282+0000 7fd26684a700 1 --2- 172.21.15.139:0/278202264 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd26012c210 0x7fd26009e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:18.297 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.282+0000 7fd26684a700 1 -- 172.21.15.139:0/278202264 >> v1:172.21.15.139:6789/0 conn(0x7fd26009e650 legacy=0x7fd26007e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:18.297 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.282+0000 7fd26684a700 1 -- 172.21.15.139:0/278202264 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd260098fd0 con 0x7fd24c0044d0 2020-02-12T14:12:18.297 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.282+0000 7fd266049700 1 --2- 172.21.15.139:0/278202264 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd26012c210 0x7fd26009e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T14:12:18.297 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.282+0000 7fd26684a700 1 --2- 172.21.15.139:0/278202264 >> v2:172.21.15.139:3300/0 conn(0x7fd24c0044d0 0x7fd2600a0850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd258001450 tx=0x7fd258004210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:18.298 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.282+0000 7fd26684a700 1 --2- 172.21.15.139:0/278202264 >> v2:172.21.15.139:3300/0 conn(0x7fd24c0044d0 0x7fd2600a0850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd258001450 tx=0x7fd258004210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:18.298 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.282+0000 7fd26684a700 1 --2- 172.21.15.139:0/278202264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd24c0044d0 0x7fd2600a0850 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7fd258001450 tx=0x7fd258004210).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:18.298 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.282+0000 7fd26684a700 1 --2- 172.21.15.139:0/278202264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd24c0044d0 0x7fd2600a0850 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fd258001450 tx=0x7fd258004210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:18.298 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.282+0000 7fd2537fe700 1 -- 172.21.15.139:0/278202264 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd258012d80 con 0x7fd24c0044d0 2020-02-12T14:12:18.298 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.282+0000 7fd2682ad700 1 -- 172.21.15.139:0/278202264 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd260099270 con 0x7fd24c0044d0 2020-02-12T14:12:18.298 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.283+0000 7fd2682ad700 1 -- 172.21.15.139:0/278202264 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd260098370 con 0x7fd24c0044d0 2020-02-12T14:12:18.298 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.283+0000 7fd26684a700 1 --2- 172.21.15.139:0/278202264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd24c0044d0 0x7fd2600a0850 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fd258001450 tx=0x7fd258004210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:18.299 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.283+0000 7fd26684a700 1 --2- 172.21.15.139:0/278202264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd24c0044d0 0x7fd2600a0850 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fd258001450 tx=0x7fd258004210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:18.299 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.283+0000 7fd2537fe700 1 -- 172.21.15.139:0/278202264 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25800c890 con 0x7fd24c0044d0 2020-02-12T14:12:18.299 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.283+0000 7fd2537fe700 1 -- 172.21.15.139:0/278202264 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd25800cc30 con 0x7fd24c0044d0 2020-02-12T14:12:18.300 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.284+0000 7fd26684a700 1 --2- 172.21.15.139:0/278202264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd24c0044d0 0x7fd2600a0850 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fd258001450 tx=0x7fd258004210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:18.300 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.284+0000 7fd2682ad700 1 -- 172.21.15.139:0/278202264 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd26009de20 con 0x7fd24c0044d0 2020-02-12T14:12:18.300 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.284+0000 7fd2537fe700 1 -- 172.21.15.139:0/278202264 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) v1 ==== 349+0+0 (secure 0 0 0) 0x7fd258006c00 con 0x7fd24c0044d0 2020-02-12T14:12:18.300 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.284+0000 7fd26684a700 1 --2- 172.21.15.139:0/278202264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd24c0044d0 0x7fd2600a0850 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fd258001450 tx=0x7fd258004210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:18.300 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.284+0000 7fd2537fe700 1 -- 172.21.15.139:0/278202264 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fd2580105c0 con 0x7fd24c0044d0 2020-02-12T14:12:18.300 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.286+0000 7fd26684a700 1 --2- 172.21.15.139:0/278202264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd24c0044d0 0x7fd2600a0850 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fd258001450 tx=0x7fd258004210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:18.301 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.286+0000 7fd2537fe700 1 -- 172.21.15.139:0/278202264 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67678 (secure 0 0 0) 0x7fd25800e690 con 0x7fd24c0044d0 2020-02-12T14:12:18.368 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.367+0000 7fd2682ad700 1 -- 172.21.15.139:0/278202264 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fd260067e20 con 0x7fd24c0044d0 2020-02-12T14:12:18.376 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.375+0000 7fd26684a700 1 --2- 172.21.15.139:0/278202264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd24c0044d0 0x7fd2600a0850 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fd258001450 tx=0x7fd258004210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:18.376 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.375+0000 7fd2537fe700 1 -- 172.21.15.139:0/278202264 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fd25800e880 con 0x7fd24c0044d0 2020-02-12T14:12:18.378 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.376+0000 7fd2682ad700 1 -- 172.21.15.139:0/278202264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd24c0044d0 msgr2=0x7fd2600a0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:18.378 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.376+0000 7fd2682ad700 1 --2- 172.21.15.139:0/278202264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd24c0044d0 0x7fd2600a0850 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7fd258001450 tx=0x7fd258004210).stop 2020-02-12T14:12:18.378 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.376+0000 7fd2682ad700 1 -- 172.21.15.139:0/278202264 shutdown_connections 2020-02-12T14:12:18.378 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.376+0000 7fd2682ad700 1 --2- 172.21.15.139:0/278202264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd24c0044d0 0x7fd2600a0850 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:18.379 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.376+0000 7fd2682ad700 1 --2- 172.21.15.139:0/278202264 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd26012c210 0x7fd26009e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:18.379 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.376+0000 7fd2682ad700 1 -- 172.21.15.139:0/278202264 >> 172.21.15.139:0/278202264 conn(0x7fd26005a720 msgr2=0x7fd26005e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:18.379 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.376+0000 7fd2682ad700 1 -- 172.21.15.139:0/278202264 shutdown_connections 2020-02-12T14:12:18.379 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:18.376+0000 7fd2682ad700 1 -- 172.21.15.139:0/278202264 wait complete. 2020-02-12T14:12:18.379 INFO:teuthology.orchestra.run.smithi139.stderr:adjusted tunables profile to default 2020-02-12T14:12:18.388 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-02-12T14:12:18.388 INFO:teuthology.orchestra.run.smithi072:> mktemp 2020-02-12T14:12:18.403 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.v20Soprkt8 2020-02-12T14:12:18.403 INFO:teuthology.orchestra.run.smithi072:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.v20Soprkt8 2020-02-12T14:12:18.470 INFO:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.v20Soprkt8 2020-02-12T14:12:18.595 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.v20Soprkt8 is 37B 2020-02-12T14:12:18.641 INFO:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.v20Soprkt8 2020-02-12T14:12:18.655 INFO:teuthology.orchestra.run.smithi072:> mktemp 2020-02-12T14:12:18.709 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.rhF9APaaBa 2020-02-12T14:12:18.709 INFO:teuthology.orchestra.run.smithi072:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.rhF9APaaBa 2020-02-12T14:12:18.776 INFO:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.rhF9APaaBa 2020-02-12T14:12:18.899 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.rhF9APaaBa is 37B 2020-02-12T14:12:18.916 INFO:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.rhF9APaaBa 2020-02-12T14:12:18.930 INFO:teuthology.orchestra.run.smithi072:> mktemp 2020-02-12T14:12:18.983 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.7El1Pa3TfS 2020-02-12T14:12:18.983 INFO:teuthology.orchestra.run.smithi072:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.7El1Pa3TfS 2020-02-12T14:12:19.050 INFO:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.7El1Pa3TfS 2020-02-12T14:12:19.174 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.7El1Pa3TfS is 37B 2020-02-12T14:12:19.221 INFO:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.7El1Pa3TfS 2020-02-12T14:12:19.236 INFO:teuthology.orchestra.run.smithi072:> mktemp 2020-02-12T14:12:19.293 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.y2Ygt43rK3 2020-02-12T14:12:19.293 INFO:teuthology.orchestra.run.smithi072:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.y2Ygt43rK3 2020-02-12T14:12:19.361 INFO:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.y2Ygt43rK3 2020-02-12T14:12:19.487 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.y2Ygt43rK3 is 37B 2020-02-12T14:12:19.534 INFO:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.y2Ygt43rK3 2020-02-12T14:12:19.548 INFO:teuthology.orchestra.run.smithi139:> mktemp 2020-02-12T14:12:19.562 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.GJ1mi4BV5K 2020-02-12T14:12:19.562 INFO:teuthology.orchestra.run.smithi139:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.GJ1mi4BV5K 2020-02-12T14:12:19.630 INFO:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.GJ1mi4BV5K 2020-02-12T14:12:19.755 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.GJ1mi4BV5K is 37B 2020-02-12T14:12:19.803 INFO:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.GJ1mi4BV5K 2020-02-12T14:12:19.816 INFO:teuthology.orchestra.run.smithi139:> mktemp 2020-02-12T14:12:19.869 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.KkSD7BLind 2020-02-12T14:12:19.869 INFO:teuthology.orchestra.run.smithi139:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.KkSD7BLind 2020-02-12T14:12:19.937 INFO:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.KkSD7BLind 2020-02-12T14:12:20.063 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.KkSD7BLind is 37B 2020-02-12T14:12:20.111 INFO:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.KkSD7BLind 2020-02-12T14:12:20.125 INFO:teuthology.orchestra.run.smithi139:> mktemp 2020-02-12T14:12:20.180 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.CbUpmhtGwH 2020-02-12T14:12:20.181 INFO:teuthology.orchestra.run.smithi139:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.CbUpmhtGwH 2020-02-12T14:12:20.249 INFO:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.CbUpmhtGwH 2020-02-12T14:12:20.373 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.CbUpmhtGwH is 37B 2020-02-12T14:12:20.421 INFO:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.CbUpmhtGwH 2020-02-12T14:12:20.435 INFO:teuthology.orchestra.run.smithi139:> mktemp 2020-02-12T14:12:20.489 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.lrqrOeO7xN 2020-02-12T14:12:20.490 INFO:teuthology.orchestra.run.smithi139:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.lrqrOeO7xN 2020-02-12T14:12:20.557 INFO:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.lrqrOeO7xN 2020-02-12T14:12:20.681 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.lrqrOeO7xN is 37B 2020-02-12T14:12:20.728 INFO:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.lrqrOeO7xN 2020-02-12T14:12:20.742 INFO:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new ffc0664d-9b93-45a4-a454-7655ee26d582 0 2020-02-12T14:12:20.891 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.887+0000 7f3a70da6700 1 Processor -- start 2020-02-12T14:12:20.891 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.887+0000 7f3a70da6700 1 -- start start 2020-02-12T14:12:20.891 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.887+0000 7f3a70da6700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3a6c07fc00 0x7f3a6c0a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:20.891 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.887+0000 7f3a70da6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a6c0a6d90 0x7f3a6c14e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:20.892 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.887+0000 7f3a70da6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6c09a700 con 0x7f3a6c0a4140 2020-02-12T14:12:20.892 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.887+0000 7f3a70da6700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a6c0a5520 con 0x7f3a6c07fc00 2020-02-12T14:12:20.892 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.887+0000 7f3a70da6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c0a57c0 con 0x7f3a6c0a6d90 2020-02-12T14:12:20.892 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.888+0000 7f3a63fff700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3a6c07fc00 0x7f3a6c0a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:20.892 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.888+0000 7f3a63fff700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3a6c07fc00 0x7f3a6c0a4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46032/0 (socket says 172.21.15.139:46032) 2020-02-12T14:12:20.892 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.888+0000 7f3a63fff700 1 -- 172.21.15.139:0/1541510232 learned_addr learned my addr 172.21.15.139:0/1541510232 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:20.892 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.888+0000 7f3a6b59e700 1 --2- 172.21.15.139:0/1541510232 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a6c0a6d90 0x7f3a6c14e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:20.892 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.888+0000 7f3a63fff700 1 -- 172.21.15.139:0/1541510232 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a6c0a6d90 msgr2=0x7f3a6c14e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:20.893 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.888+0000 7f3a63fff700 1 --2- 172.21.15.139:0/1541510232 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a6c0a6d90 0x7f3a6c14e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:20.893 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.888+0000 7f3a63fff700 1 -- 172.21.15.139:0/1541510232 >> v1:172.21.15.72:6789/0 conn(0x7f3a6c0a4140 legacy=0x7f3a6c0a6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:20.893 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.888+0000 7f3a63fff700 1 -- 172.21.15.139:0/1541510232 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6c14fe00 con 0x7f3a6c07fc00 2020-02-12T14:12:20.893 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.888+0000 7f3a63fff700 1 --2- 172.21.15.139:0/1541510232 >> v2:172.21.15.139:3300/0 conn(0x7f3a6c07fc00 0x7f3a6c0a4fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3a54002f30 tx=0x7f3a540088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:20.893 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.888+0000 7f3a63fff700 1 --2- 172.21.15.139:0/1541510232 >> v2:172.21.15.139:3300/0 conn(0x7f3a6c07fc00 0x7f3a6c0a4fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3a54002f30 tx=0x7f3a540088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:20.893 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.888+0000 7f3a63fff700 1 --2- 172.21.15.139:0/1541510232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a6c07fc00 0x7f3a6c0a4fd0 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7f3a54002f30 tx=0x7f3a540088e0).ready entity=mon.1 client_cookie=dfbfe66de0665bcc server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:20.893 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.888+0000 7f3a63fff700 1 --2- 172.21.15.139:0/1541510232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a6c07fc00 0x7f3a6c0a4fd0 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f3a54002f30 tx=0x7f3a540088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:20.894 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.888+0000 7f3a63fff700 1 --2- 172.21.15.139:0/1541510232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a6c07fc00 0x7f3a6c0a4fd0 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f3a54002f30 tx=0x7f3a540088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:20.894 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.888+0000 7f3a6a59c700 1 -- 172.21.15.139:0/1541510232 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a540116b0 con 0x7f3a6c07fc00 2020-02-12T14:12:20.894 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.888+0000 7f3a63fff700 1 --2- 172.21.15.139:0/1541510232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a6c07fc00 0x7f3a6c0a4fd0 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f3a54002f30 tx=0x7f3a540088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:20.894 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.888+0000 7f3a6a59c700 1 -- 172.21.15.139:0/1541510232 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a54011810 con 0x7f3a6c07fc00 2020-02-12T14:12:20.894 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.888+0000 7f3a6a59c700 1 -- 172.21.15.139:0/1541510232 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a54011bf0 con 0x7f3a6c07fc00 2020-02-12T14:12:20.894 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.888+0000 7f3a70da6700 1 -- 172.21.15.139:0/1541510232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a6c07fc00 msgr2=0x7f3a6c0a4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:20.894 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.888+0000 7f3a70da6700 1 --2- 172.21.15.139:0/1541510232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a6c07fc00 0x7f3a6c0a4fd0 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7f3a54002f30 tx=0x7f3a540088e0).stop 2020-02-12T14:12:20.895 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.889+0000 7f3a70da6700 1 -- 172.21.15.139:0/1541510232 shutdown_connections 2020-02-12T14:12:20.895 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.889+0000 7f3a70da6700 1 --2- 172.21.15.139:0/1541510232 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a6c0a6d90 0x7f3a6c14e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:20.895 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.889+0000 7f3a70da6700 1 --2- 172.21.15.139:0/1541510232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a6c07fc00 0x7f3a6c0a4fd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:20.895 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.889+0000 7f3a70da6700 1 -- 172.21.15.139:0/1541510232 >> 172.21.15.139:0/1541510232 conn(0x7f3a6c05a720 msgr2=0x7f3a6c05ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:20.895 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.889+0000 7f3a70da6700 1 -- 172.21.15.139:0/1541510232 shutdown_connections 2020-02-12T14:12:20.895 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.889+0000 7f3a70da6700 1 -- 172.21.15.139:0/1541510232 wait complete. 2020-02-12T14:12:20.895 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.890+0000 7f3a70da6700 1 Processor -- start 2020-02-12T14:12:20.896 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.890+0000 7f3a70da6700 1 -- start start 2020-02-12T14:12:20.898 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.890+0000 7f3a70da6700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3a6c0a6d90 0x7f3a6c0644b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:20.899 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.890+0000 7f3a70da6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6c065e70 con 0x7f3a6c07fc00 2020-02-12T14:12:20.899 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.890+0000 7f3a70da6700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6c066110 con 0x7f3a6c0a4140 2020-02-12T14:12:20.899 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.890+0000 7f3a70da6700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a6c0665a0 con 0x7f3a6c0a6d90 2020-02-12T14:12:20.899 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.890+0000 7f3a6b59e700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3a6c0a6d90 0x7f3a6c0644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:20.899 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.890+0000 7f3a63fff700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f3a6c0a4140 0x7f3a6c07e5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:34678/0 (socket says 172.21.15.139:34678) 2020-02-12T14:12:20.899 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.890+0000 7f3a63fff700 1 -- 172.21.15.139:0/3731580754 learned_addr learned my addr 172.21.15.139:0/3731580754 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:20.899 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.891+0000 7f3a637fe700 1 -- 172.21.15.139:0/3731580754 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2329644663 0 0) 0x7f3a6c065e70 con 0x7f3a6c07fc00 2020-02-12T14:12:20.900 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.891+0000 7f3a637fe700 1 -- 172.21.15.139:0/3731580754 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a50003230 con 0x7f3a6c07fc00 2020-02-12T14:12:20.900 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.891+0000 7f3a6b59e700 1 -- 172.21.15.139:0/3731580754 >> v1:172.21.15.139:6789/0 conn(0x7f3a6c0a4140 legacy=0x7f3a6c07e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:20.900 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.891+0000 7f3a6b59e700 1 -- 172.21.15.139:0/3731580754 >> v1:172.21.15.72:6789/0 conn(0x7f3a6c07fc00 legacy=0x7f3a6c062ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:20.900 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.891+0000 7f3a637fe700 1 -- 172.21.15.139:0/3731580754 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641518277 0 0) 0x7f3a6c066110 con 0x7f3a6c0a4140 2020-02-12T14:12:20.900 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.891+0000 7f3a6b59e700 1 -- 172.21.15.139:0/3731580754 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6c0635b0 con 0x7f3a6c0a6d90 2020-02-12T14:12:20.900 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.891+0000 7f3a6b59e700 1 --2- 172.21.15.139:0/3731580754 >> v2:172.21.15.139:3300/0 conn(0x7f3a6c0a6d90 0x7f3a6c0644b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3a640032b0 tx=0x7f3a64010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:20.900 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.891+0000 7f3a6b59e700 1 --2- 172.21.15.139:0/3731580754 >> v2:172.21.15.139:3300/0 conn(0x7f3a6c0a6d90 0x7f3a6c0644b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3a640032b0 tx=0x7f3a64010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:20.901 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.891+0000 7f3a6b59e700 1 --2- 172.21.15.139:0/3731580754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a6c0a6d90 0x7f3a6c0644b0 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7f3a640032b0 tx=0x7f3a64010eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:20.901 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.891+0000 7f3a6b59e700 1 --2- 172.21.15.139:0/3731580754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a6c0a6d90 0x7f3a6c0644b0 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f3a640032b0 tx=0x7f3a64010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:20.901 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.891+0000 7f3a637fe700 1 -- 172.21.15.139:0/3731580754 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a64005e30 con 0x7f3a6c0a6d90 2020-02-12T14:12:20.901 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.891+0000 7f3a6b59e700 1 --2- 172.21.15.139:0/3731580754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a6c0a6d90 0x7f3a6c0644b0 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f3a640032b0 tx=0x7f3a64010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:20.901 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.891+0000 7f3a6b59e700 1 --2- 172.21.15.139:0/3731580754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a6c0a6d90 0x7f3a6c0644b0 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f3a640032b0 tx=0x7f3a64010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:20.901 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.891+0000 7f3a637fe700 1 -- 172.21.15.139:0/3731580754 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a64007540 con 0x7f3a6c0a6d90 2020-02-12T14:12:20.901 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.891+0000 7f3a70da6700 1 -- 172.21.15.139:0/3731580754 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a6c065b60 con 0x7f3a6c0a6d90 2020-02-12T14:12:20.902 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.891+0000 7f3a637fe700 1 -- 172.21.15.139:0/3731580754 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a640078e0 con 0x7f3a6c0a6d90 2020-02-12T14:12:20.902 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.891+0000 7f3a70da6700 1 -- 172.21.15.139:0/3731580754 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a6c063ae0 con 0x7f3a6c0a6d90 2020-02-12T14:12:20.902 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.891+0000 7f3a6b59e700 1 --2- 172.21.15.139:0/3731580754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a6c0a6d90 0x7f3a6c0644b0 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f3a640032b0 tx=0x7f3a64010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:20.902 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.891+0000 7f3a6b59e700 1 --2- 172.21.15.139:0/3731580754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a6c0a6d90 0x7f3a6c0644b0 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f3a640032b0 tx=0x7f3a64010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:20.902 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.891+0000 7f3a637fe700 1 -- 172.21.15.139:0/3731580754 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) v1 ==== 349+0+0 (secure 0 0 0) 0x7f3a640128f0 con 0x7f3a6c0a6d90 2020-02-12T14:12:20.902 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.891+0000 7f3a637fe700 1 -- 172.21.15.139:0/3731580754 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f3a6400a860 con 0x7f3a6c0a6d90 2020-02-12T14:12:20.902 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.892+0000 7f3a70da6700 1 -- 172.21.15.139:0/3731580754 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a6c062b90 con 0x7f3a6c0a6d90 2020-02-12T14:12:20.903 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.894+0000 7f3a6b59e700 1 --2- 172.21.15.139:0/3731580754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a6c0a6d90 0x7f3a6c0644b0 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f3a640032b0 tx=0x7f3a64010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:20.903 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.894+0000 7f3a637fe700 1 -- 172.21.15.139:0/3731580754 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67678 (secure 0 0 0) 0x7f3a6400aa70 con 0x7f3a6c0a6d90 2020-02-12T14:12:20.979 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.978+0000 7f3a70da6700 1 -- 172.21.15.139:0/3731580754 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ffc0664d-9b93-45a4-a454-7655ee26d582", "id": 0} v 0) v1 -- 0x7f3a6c067e20 con 0x7f3a6c0a6d90 2020-02-12T14:12:20.985 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.984+0000 7f3a6b59e700 1 --2- 172.21.15.139:0/3731580754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a6c0a6d90 0x7f3a6c0644b0 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f3a640032b0 tx=0x7f3a64010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:20.985 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.984+0000 7f3a637fe700 1 -- 172.21.15.139:0/3731580754 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ffc0664d-9b93-45a4-a454-7655ee26d582", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3a6400ac10 con 0x7f3a6c0a6d90 2020-02-12T14:12:20.985 INFO:teuthology.orchestra.run.smithi139.stdout:0 2020-02-12T14:12:20.986 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.985+0000 7f3a70da6700 1 -- 172.21.15.139:0/3731580754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a6c0a6d90 msgr2=0x7f3a6c0644b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:20.986 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.985+0000 7f3a70da6700 1 --2- 172.21.15.139:0/3731580754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a6c0a6d90 0x7f3a6c0644b0 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7f3a640032b0 tx=0x7f3a64010eb0).stop 2020-02-12T14:12:20.987 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.985+0000 7f3a70da6700 1 -- 172.21.15.139:0/3731580754 shutdown_connections 2020-02-12T14:12:20.987 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.985+0000 7f3a70da6700 1 --2- 172.21.15.139:0/3731580754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a6c0a6d90 0x7f3a6c0644b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:20.987 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.985+0000 7f3a70da6700 1 -- 172.21.15.139:0/3731580754 >> 172.21.15.139:0/3731580754 conn(0x7f3a6c05a720 msgr2=0x7f3a6c05e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:20.987 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.985+0000 7f3a70da6700 1 -- 172.21.15.139:0/3731580754 shutdown_connections 2020-02-12T14:12:20.987 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:20.985+0000 7f3a70da6700 1 -- 172.21.15.139:0/3731580754 wait complete. 2020-02-12T14:12:20.996 INFO:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new f66da6bc-43b3-4846-85f9-a25e3fe95216 1 2020-02-12T14:12:21.107 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.102+0000 7fa0f9663700 1 Processor -- start 2020-02-12T14:12:21.107 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.102+0000 7fa0f9663700 1 -- start start 2020-02-12T14:12:21.107 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.103+0000 7fa0f9663700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa0f40a4140 0x7fa0f40a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:21.107 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.103+0000 7fa0f9663700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f409a700 con 0x7fa0f407fc00 2020-02-12T14:12:21.107 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.103+0000 7fa0f9663700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f40a5520 con 0x7fa0f40a6d90 2020-02-12T14:12:21.108 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.103+0000 7fa0f9663700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f40a57c0 con 0x7fa0f40a4140 2020-02-12T14:12:21.108 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.103+0000 7fa0f3fff700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fa0f40a6d90 0x7fa0f414e990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:34686/0 (socket says 172.21.15.139:34686) 2020-02-12T14:12:21.108 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.103+0000 7fa0f3fff700 1 -- 172.21.15.139:0/3282973597 learned_addr learned my addr 172.21.15.139:0/3282973597 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:21.108 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.103+0000 7fa0f37fe700 1 --2- 172.21.15.139:0/3282973597 >> v2:172.21.15.72:3300/0 conn(0x7fa0f40a4140 0x7fa0f40a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:21.108 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.103+0000 7fa0f27fc700 1 -- 172.21.15.139:0/3282973597 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916253608 0 0) 0x7fa0f40a5520 con 0x7fa0f40a6d90 2020-02-12T14:12:21.108 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.103+0000 7fa0f27fc700 1 -- 172.21.15.139:0/3282973597 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0dc003230 con 0x7fa0f40a6d90 2020-02-12T14:12:21.108 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.104+0000 7fa0f37fe700 1 -- 172.21.15.139:0/3282973597 >> v1:172.21.15.139:6789/0 conn(0x7fa0f40a6d90 legacy=0x7fa0f414e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:21.109 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.104+0000 7fa0f37fe700 1 -- 172.21.15.139:0/3282973597 >> v1:172.21.15.72:6789/0 conn(0x7fa0f407fc00 legacy=0x7fa0f40a6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:21.109 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.104+0000 7fa0f27fc700 1 -- 172.21.15.139:0/3282973597 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2544805954 0 0) 0x7fa0f409a700 con 0x7fa0f407fc00 2020-02-12T14:12:21.109 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.104+0000 7fa0f37fe700 1 -- 172.21.15.139:0/3282973597 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f41520d0 con 0x7fa0f40a4140 2020-02-12T14:12:21.109 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.104+0000 7fa0f37fe700 1 --2- 172.21.15.139:0/3282973597 >> v2:172.21.15.72:3300/0 conn(0x7fa0f40a4140 0x7fa0f40a4fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa0e8002f30 tx=0x7fa0e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.109 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.104+0000 7fa0f37fe700 1 --2- 172.21.15.139:0/3282973597 >> v2:172.21.15.72:3300/0 conn(0x7fa0f40a4140 0x7fa0f40a4fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa0e8002f30 tx=0x7fa0e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.109 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.104+0000 7fa0f37fe700 1 --2- 172.21.15.139:0/3282973597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0f40a4140 0x7fa0f40a4fd0 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7fa0e8002f30 tx=0x7fa0e80088e0).ready entity=mon.0 client_cookie=da1d78c3a154a4e1 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:21.109 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.104+0000 7fa0f37fe700 1 --2- 172.21.15.139:0/3282973597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0f40a4140 0x7fa0f40a4fd0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7fa0e8002f30 tx=0x7fa0e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.104+0000 7fa0f27fc700 1 -- 172.21.15.139:0/3282973597 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0e8008e40 con 0x7fa0f40a4140 2020-02-12T14:12:21.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.104+0000 7fa0f37fe700 1 --2- 172.21.15.139:0/3282973597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0f40a4140 0x7fa0f40a4fd0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7fa0e8002f30 tx=0x7fa0e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.104+0000 7fa0f27fc700 1 -- 172.21.15.139:0/3282973597 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e80115f0 con 0x7fa0f40a4140 2020-02-12T14:12:21.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.104+0000 7fa0f37fe700 1 --2- 172.21.15.139:0/3282973597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0f40a4140 0x7fa0f40a4fd0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7fa0e8002f30 tx=0x7fa0e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.104+0000 7fa0f27fc700 1 -- 172.21.15.139:0/3282973597 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0e8011950 con 0x7fa0f40a4140 2020-02-12T14:12:21.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.104+0000 7fa0f9663700 1 -- 172.21.15.139:0/3282973597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0f40a4140 msgr2=0x7fa0f40a4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:21.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.104+0000 7fa0f9663700 1 --2- 172.21.15.139:0/3282973597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0f40a4140 0x7fa0f40a4fd0 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7fa0e8002f30 tx=0x7fa0e80088e0).stop 2020-02-12T14:12:21.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.105+0000 7fa0f9663700 1 -- 172.21.15.139:0/3282973597 shutdown_connections 2020-02-12T14:12:21.111 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.105+0000 7fa0f9663700 1 --2- 172.21.15.139:0/3282973597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0f40a4140 0x7fa0f40a4fd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:21.111 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.105+0000 7fa0f9663700 1 -- 172.21.15.139:0/3282973597 >> 172.21.15.139:0/3282973597 conn(0x7fa0f405a720 msgr2=0x7fa0f405ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:21.111 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.105+0000 7fa0f9663700 1 -- 172.21.15.139:0/3282973597 shutdown_connections 2020-02-12T14:12:21.111 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.105+0000 7fa0f9663700 1 -- 172.21.15.139:0/3282973597 wait complete. 2020-02-12T14:12:21.111 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.106+0000 7fa0f9663700 1 Processor -- start 2020-02-12T14:12:21.111 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.106+0000 7fa0f9663700 1 -- start start 2020-02-12T14:12:21.114 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.106+0000 7fa0f9663700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa0f407fc00 0x7fa0f4121580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:21.114 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.106+0000 7fa0f9663700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa0f40a4140 0x7fa0f409b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:21.114 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.106+0000 7fa0f9663700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f4125db0 con 0x7fa0f40a6d90 2020-02-12T14:12:21.114 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.106+0000 7fa0f9663700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f407f510 con 0x7fa0f40a4140 2020-02-12T14:12:21.115 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.106+0000 7fa0f9663700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f409d740 con 0x7fa0f407fc00 2020-02-12T14:12:21.115 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.106+0000 7fa0f2ffd700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa0f40a4140 0x7fa0f409b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:21.115 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.106+0000 7fa0f2ffd700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa0f40a4140 0x7fa0f409b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46052/0 (socket says 172.21.15.139:46052) 2020-02-12T14:12:21.115 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.106+0000 7fa0f2ffd700 1 -- 172.21.15.139:0/2517882585 learned_addr learned my addr 172.21.15.139:0/2517882585 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:21.115 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.107+0000 7fa0f37fe700 1 --2- 172.21.15.139:0/2517882585 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa0f407fc00 0x7fa0f4121580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:21.115 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.107+0000 7fa0dbfff700 1 -- 172.21.15.139:0/2517882585 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3801891102 0 0) 0x7fa0f4125db0 con 0x7fa0f40a6d90 2020-02-12T14:12:21.115 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.107+0000 7fa0f2ffd700 1 -- 172.21.15.139:0/2517882585 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa0f407fc00 msgr2=0x7fa0f4121580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:21.116 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.107+0000 7fa0f2ffd700 1 --2- 172.21.15.139:0/2517882585 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa0f407fc00 0x7fa0f4121580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:21.116 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.107+0000 7fa0f2ffd700 1 -- 172.21.15.139:0/2517882585 >> v1:172.21.15.72:6789/0 conn(0x7fa0f40a6d90 legacy=0x7fa0f409be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:21.116 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.107+0000 7fa0f2ffd700 1 -- 172.21.15.139:0/2517882585 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f4126590 con 0x7fa0f40a4140 2020-02-12T14:12:21.116 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.107+0000 7fa0f2ffd700 1 --2- 172.21.15.139:0/2517882585 >> v2:172.21.15.139:3300/0 conn(0x7fa0f40a4140 0x7fa0f409b9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa0e4000b80 tx=0x7fa0e400c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.116 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.107+0000 7fa0f2ffd700 1 --2- 172.21.15.139:0/2517882585 >> v2:172.21.15.139:3300/0 conn(0x7fa0f40a4140 0x7fa0f409b9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa0e4000b80 tx=0x7fa0e400c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.116 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.107+0000 7fa0f2ffd700 1 --2- 172.21.15.139:0/2517882585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0f40a4140 0x7fa0f409b9e0 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7fa0e4000b80 tx=0x7fa0e400c490).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:21.116 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.107+0000 7fa0f2ffd700 1 --2- 172.21.15.139:0/2517882585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0f40a4140 0x7fa0f409b9e0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7fa0e4000b80 tx=0x7fa0e400c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.116 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.107+0000 7fa0dbfff700 1 -- 172.21.15.139:0/2517882585 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0e400cc20 con 0x7fa0f40a4140 2020-02-12T14:12:21.117 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.107+0000 7fa0f2ffd700 1 --2- 172.21.15.139:0/2517882585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0f40a4140 0x7fa0f409b9e0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7fa0e4000b80 tx=0x7fa0e400c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.117 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.107+0000 7fa0f2ffd700 1 --2- 172.21.15.139:0/2517882585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0f40a4140 0x7fa0f409b9e0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7fa0e4000b80 tx=0x7fa0e400c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.117 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.107+0000 7fa0dbfff700 1 -- 172.21.15.139:0/2517882585 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e400cd80 con 0x7fa0f40a4140 2020-02-12T14:12:21.117 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.107+0000 7fa0f9663700 1 -- 172.21.15.139:0/2517882585 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f4125fe0 con 0x7fa0f40a4140 2020-02-12T14:12:21.117 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.107+0000 7fa0dbfff700 1 -- 172.21.15.139:0/2517882585 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0e4012220 con 0x7fa0f40a4140 2020-02-12T14:12:21.117 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.107+0000 7fa0f9663700 1 -- 172.21.15.139:0/2517882585 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f409dba0 con 0x7fa0f40a4140 2020-02-12T14:12:21.117 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.107+0000 7fa0f2ffd700 1 --2- 172.21.15.139:0/2517882585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0f40a4140 0x7fa0f409b9e0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7fa0e4000b80 tx=0x7fa0e400c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.118 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.107+0000 7fa0f2ffd700 1 --2- 172.21.15.139:0/2517882585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0f40a4140 0x7fa0f409b9e0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7fa0e4000b80 tx=0x7fa0e400c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.118 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.107+0000 7fa0dbfff700 1 -- 172.21.15.139:0/2517882585 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) v1 ==== 349+0+0 (secure 0 0 0) 0x7fa0e4006880 con 0x7fa0f40a4140 2020-02-12T14:12:21.118 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.107+0000 7fa0dbfff700 1 -- 172.21.15.139:0/2517882585 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7fa0e4012c50 con 0x7fa0f40a4140 2020-02-12T14:12:21.118 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.108+0000 7fa0f9663700 1 -- 172.21.15.139:0/2517882585 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f41213d0 con 0x7fa0f40a4140 2020-02-12T14:12:21.118 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.110+0000 7fa0f2ffd700 1 --2- 172.21.15.139:0/2517882585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0f40a4140 0x7fa0f409b9e0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7fa0e4000b80 tx=0x7fa0e400c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.118 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.110+0000 7fa0dbfff700 1 -- 172.21.15.139:0/2517882585 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67678 (secure 0 0 0) 0x7fa0e4003160 con 0x7fa0f40a4140 2020-02-12T14:12:21.143 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.142+0000 7fa0f2ffd700 1 --2- 172.21.15.139:0/2517882585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0f40a4140 0x7fa0f409b9e0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7fa0e4000b80 tx=0x7fa0e400c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.144 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.143+0000 7fa0dbfff700 1 -- 172.21.15.139:0/2517882585 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mgrmap(e 2) v1 ==== 22494+0+0 (secure 0 0 0) 0x7fa0e4003300 con 0x7fa0f40a4140 2020-02-12T14:12:21.204 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.203+0000 7fa0f9663700 1 -- 172.21.15.139:0/2517882585 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f66da6bc-43b3-4846-85f9-a25e3fe95216", "id": 1} v 0) v1 -- 0x7fa0f409d8e0 con 0x7fa0f40a4140 2020-02-12T14:12:21.207 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.206+0000 7fa0f2ffd700 1 --2- 172.21.15.139:0/2517882585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0f40a4140 0x7fa0f409b9e0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7fa0e4000b80 tx=0x7fa0e400c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.207 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.206+0000 7fa0dbfff700 1 -- 172.21.15.139:0/2517882585 <== mon.1 v2:172.21.15.139:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f66da6bc-43b3-4846-85f9-a25e3fe95216", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa0f409d8e0 con 0x7fa0f40a4140 2020-02-12T14:12:21.208 INFO:teuthology.orchestra.run.smithi139.stdout:1 2020-02-12T14:12:21.209 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.207+0000 7fa0f9663700 1 -- 172.21.15.139:0/2517882585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0f40a4140 msgr2=0x7fa0f409b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:21.209 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.207+0000 7fa0f9663700 1 --2- 172.21.15.139:0/2517882585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0f40a4140 0x7fa0f409b9e0 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7fa0e4000b80 tx=0x7fa0e400c490).stop 2020-02-12T14:12:21.209 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.207+0000 7fa0f9663700 1 -- 172.21.15.139:0/2517882585 shutdown_connections 2020-02-12T14:12:21.209 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.207+0000 7fa0f9663700 1 --2- 172.21.15.139:0/2517882585 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa0f407fc00 0x7fa0f4121580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:21.209 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.207+0000 7fa0f9663700 1 --2- 172.21.15.139:0/2517882585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0f40a4140 0x7fa0f409b9e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:21.209 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.207+0000 7fa0f9663700 1 -- 172.21.15.139:0/2517882585 >> 172.21.15.139:0/2517882585 conn(0x7fa0f405a720 msgr2=0x7fa0f4128b40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:21.210 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.207+0000 7fa0f9663700 1 -- 172.21.15.139:0/2517882585 shutdown_connections 2020-02-12T14:12:21.210 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.207+0000 7fa0f9663700 1 -- 172.21.15.139:0/2517882585 wait complete. 2020-02-12T14:12:21.218 INFO:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new c35fb293-3e16-41e8-85f3-768e11e55b83 2 2020-02-12T14:12:21.324 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.320+0000 7fa6621bd700 1 Processor -- start 2020-02-12T14:12:21.325 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.321+0000 7fa6621bd700 1 -- start start 2020-02-12T14:12:21.325 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.321+0000 7fa6621bd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa65c0a30a0 0x7fa65c0a6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:21.325 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.321+0000 7fa6621bd700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa65c0a6ea0 0x7fa65c07efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:21.325 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.321+0000 7fa6621bd700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa65c0a3540 con 0x7fa65c0abad0 2020-02-12T14:12:21.325 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.321+0000 7fa6621bd700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa65c0a37e0 con 0x7fa65c0a6ea0 2020-02-12T14:12:21.325 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.321+0000 7fa6621bd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c0a65a0 con 0x7fa65c0a30a0 2020-02-12T14:12:21.326 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.321+0000 7fa66341f700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa65c0a6ea0 0x7fa65c07efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:21.326 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.321+0000 7fa6619bc700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fa65c0abad0 0x7fa65c025400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:34712/0 (socket says 172.21.15.139:34712) 2020-02-12T14:12:21.326 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.321+0000 7fa6619bc700 1 -- 172.21.15.139:0/132181491 learned_addr learned my addr 172.21.15.139:0/132181491 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:21.326 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.321+0000 7fa6611bb700 1 --2- 172.21.15.139:0/132181491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa65c0a30a0 0x7fa65c0a6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:21.326 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.322+0000 7fa66341f700 1 -- 172.21.15.139:0/132181491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa65c0a30a0 msgr2=0x7fa65c0a6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:21.327 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.322+0000 7fa66341f700 1 --2- 172.21.15.139:0/132181491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa65c0a30a0 0x7fa65c0a6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:21.327 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.322+0000 7fa66341f700 1 -- 172.21.15.139:0/132181491 >> v1:172.21.15.139:6789/0 conn(0x7fa65c0abad0 legacy=0x7fa65c025400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:21.327 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.322+0000 7fa6609ba700 1 -- 172.21.15.139:0/132181491 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3440387856 0 0) 0x7fa65c0a3540 con 0x7fa65c0abad0 2020-02-12T14:12:21.327 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.322+0000 7fa66341f700 1 -- 172.21.15.139:0/132181491 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c0abeb0 con 0x7fa65c0a6ea0 2020-02-12T14:12:21.327 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.322+0000 7fa66341f700 1 --2- 172.21.15.139:0/132181491 >> v2:172.21.15.139:3300/0 conn(0x7fa65c0a6ea0 0x7fa65c07efb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa6540032b0 tx=0x7fa654008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.327 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.322+0000 7fa66341f700 1 --2- 172.21.15.139:0/132181491 >> v2:172.21.15.139:3300/0 conn(0x7fa65c0a6ea0 0x7fa65c07efb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa6540032b0 tx=0x7fa654008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.328 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.322+0000 7fa66341f700 1 --2- 172.21.15.139:0/132181491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa65c0a6ea0 0x7fa65c07efb0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7fa6540032b0 tx=0x7fa654008c60).ready entity=mon.1 client_cookie=be963dac78ffea0c server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:21.328 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.322+0000 7fa66341f700 1 --2- 172.21.15.139:0/132181491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa65c0a6ea0 0x7fa65c07efb0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fa6540032b0 tx=0x7fa654008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.328 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.322+0000 7fa6609ba700 1 -- 172.21.15.139:0/132181491 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa65400a160 con 0x7fa65c0a6ea0 2020-02-12T14:12:21.328 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.322+0000 7fa66341f700 1 --2- 172.21.15.139:0/132181491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa65c0a6ea0 0x7fa65c07efb0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fa6540032b0 tx=0x7fa654008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.328 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.322+0000 7fa66341f700 1 --2- 172.21.15.139:0/132181491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa65c0a6ea0 0x7fa65c07efb0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fa6540032b0 tx=0x7fa654008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.328 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.322+0000 7fa6609ba700 1 -- 172.21.15.139:0/132181491 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65400a2c0 con 0x7fa65c0a6ea0 2020-02-12T14:12:21.328 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.322+0000 7fa6609ba700 1 -- 172.21.15.139:0/132181491 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa65400a660 con 0x7fa65c0a6ea0 2020-02-12T14:12:21.329 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.322+0000 7fa6621bd700 1 -- 172.21.15.139:0/132181491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa65c0a6ea0 msgr2=0x7fa65c07efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:21.329 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.322+0000 7fa6621bd700 1 --2- 172.21.15.139:0/132181491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa65c0a6ea0 0x7fa65c07efb0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7fa6540032b0 tx=0x7fa654008c60).stop 2020-02-12T14:12:21.329 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.322+0000 7fa6621bd700 1 -- 172.21.15.139:0/132181491 shutdown_connections 2020-02-12T14:12:21.329 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.322+0000 7fa6621bd700 1 --2- 172.21.15.139:0/132181491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa65c0a6ea0 0x7fa65c07efb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:21.329 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.322+0000 7fa6621bd700 1 --2- 172.21.15.139:0/132181491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa65c0a30a0 0x7fa65c0a6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:21.329 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.322+0000 7fa6621bd700 1 -- 172.21.15.139:0/132181491 >> 172.21.15.139:0/132181491 conn(0x7fa65c05f970 msgr2=0x7fa65c05fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:21.329 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.322+0000 7fa6621bd700 1 -- 172.21.15.139:0/132181491 shutdown_connections 2020-02-12T14:12:21.330 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.322+0000 7fa6621bd700 1 -- 172.21.15.139:0/132181491 wait complete. 2020-02-12T14:12:21.330 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.323+0000 7fa6621bd700 1 Processor -- start 2020-02-12T14:12:21.330 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.323+0000 7fa6621bd700 1 -- start start 2020-02-12T14:12:21.332 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.324+0000 7fa6621bd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa65c0a30a0 0x7fa65c07d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:21.332 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.324+0000 7fa6621bd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa65c0abad0 0x7fa65c13b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:21.332 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.324+0000 7fa6621bd700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa65c09c650 con 0x7fa65c0a6ea0 2020-02-12T14:12:21.333 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.324+0000 7fa6621bd700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa65c09e0b0 con 0x7fa65c0abad0 2020-02-12T14:12:21.333 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.324+0000 7fa6621bd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c09e350 con 0x7fa65c0a30a0 2020-02-12T14:12:21.333 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.324+0000 7fa66341f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa65c0abad0 0x7fa65c13b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:21.333 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.324+0000 7fa6611bb700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa65c0a6ea0 0x7fa65c09bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.139:48592/0 (socket says 172.21.15.139:48592) 2020-02-12T14:12:21.333 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.324+0000 7fa6619bc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa65c0a30a0 0x7fa65c07d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:21.333 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.324+0000 7fa6611bb700 1 -- 172.21.15.139:0/2876918489 learned_addr learned my addr 172.21.15.139:0/2876918489 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:21.333 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.325+0000 7fa66341f700 1 -- 172.21.15.139:0/2876918489 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa65c0a30a0 msgr2=0x7fa65c07d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:21.334 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.325+0000 7fa66341f700 1 --2- 172.21.15.139:0/2876918489 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa65c0a30a0 0x7fa65c07d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:21.334 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.325+0000 7fa66341f700 1 -- 172.21.15.139:0/2876918489 >> v1:172.21.15.72:6789/0 conn(0x7fa65c0a6ea0 legacy=0x7fa65c09bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:21.334 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.325+0000 7fa6527fc700 1 -- 172.21.15.139:0/2876918489 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2338917204 0 0) 0x7fa65c09c650 con 0x7fa65c0a6ea0 2020-02-12T14:12:21.334 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.325+0000 7fa66341f700 1 -- 172.21.15.139:0/2876918489 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c0a5780 con 0x7fa65c0abad0 2020-02-12T14:12:21.334 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.325+0000 7fa66341f700 1 --2- 172.21.15.139:0/2876918489 >> v2:172.21.15.72:3300/0 conn(0x7fa65c0abad0 0x7fa65c13b4d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa6540032b0 tx=0x7fa65c0ac040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.334 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.325+0000 7fa66341f700 1 --2- 172.21.15.139:0/2876918489 >> v2:172.21.15.72:3300/0 conn(0x7fa65c0abad0 0x7fa65c13b4d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa6540032b0 tx=0x7fa65c0ac040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.334 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.325+0000 7fa66341f700 1 --2- 172.21.15.139:0/2876918489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa65c0abad0 0x7fa65c13b4d0 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7fa6540032b0 tx=0x7fa65c0ac040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:21.334 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.325+0000 7fa66341f700 1 --2- 172.21.15.139:0/2876918489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa65c0abad0 0x7fa65c13b4d0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fa6540032b0 tx=0x7fa65c0ac040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.335 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.325+0000 7fa6527fc700 1 -- 172.21.15.139:0/2876918489 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa654008a70 con 0x7fa65c0abad0 2020-02-12T14:12:21.335 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.325+0000 7fa66341f700 1 --2- 172.21.15.139:0/2876918489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa65c0abad0 0x7fa65c13b4d0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fa6540032b0 tx=0x7fa65c0ac040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.335 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.325+0000 7fa66341f700 1 --2- 172.21.15.139:0/2876918489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa65c0abad0 0x7fa65c13b4d0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fa6540032b0 tx=0x7fa65c0ac040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.335 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.325+0000 7fa6527fc700 1 -- 172.21.15.139:0/2876918489 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65400ae80 con 0x7fa65c0abad0 2020-02-12T14:12:21.335 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.325+0000 7fa6527fc700 1 -- 172.21.15.139:0/2876918489 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa654005e20 con 0x7fa65c0abad0 2020-02-12T14:12:21.335 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.325+0000 7fa6621bd700 1 -- 172.21.15.139:0/2876918489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa65c0a04f0 con 0x7fa65c0abad0 2020-02-12T14:12:21.335 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.325+0000 7fa6621bd700 1 -- 172.21.15.139:0/2876918489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa65c07dbe0 con 0x7fa65c0abad0 2020-02-12T14:12:21.336 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.325+0000 7fa66341f700 1 --2- 172.21.15.139:0/2876918489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa65c0abad0 0x7fa65c13b4d0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fa6540032b0 tx=0x7fa65c0ac040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.336 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.325+0000 7fa6527fc700 1 -- 172.21.15.139:0/2876918489 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 2) v1 ==== 22494+0+0 (secure 0 0 0) 0x7fa65400f570 con 0x7fa65c0abad0 2020-02-12T14:12:21.336 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.325+0000 7fa66341f700 1 --2- 172.21.15.139:0/2876918489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa65c0abad0 0x7fa65c13b4d0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fa6540032b0 tx=0x7fa65c0ac040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.336 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.325+0000 7fa6527fc700 1 -- 172.21.15.139:0/2876918489 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7fa6540298e0 con 0x7fa65c0abad0 2020-02-12T14:12:21.336 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.326+0000 7fa6621bd700 1 -- 172.21.15.139:0/2876918489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa65c067e20 con 0x7fa65c0abad0 2020-02-12T14:12:21.336 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.328+0000 7fa66341f700 1 --2- 172.21.15.139:0/2876918489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa65c0abad0 0x7fa65c13b4d0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fa6540032b0 tx=0x7fa65c0ac040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.336 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.328+0000 7fa6527fc700 1 -- 172.21.15.139:0/2876918489 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67678 (secure 0 0 0) 0x7fa65400f9e0 con 0x7fa65c0abad0 2020-02-12T14:12:21.413 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.412+0000 7fa6621bd700 1 -- 172.21.15.139:0/2876918489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c35fb293-3e16-41e8-85f3-768e11e55b83", "id": 2} v 0) v1 -- 0x7fa65c09e4c0 con 0x7fa65c0abad0 2020-02-12T14:12:21.418 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.416+0000 7fa66341f700 1 --2- 172.21.15.139:0/2876918489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa65c0abad0 0x7fa65c13b4d0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fa6540032b0 tx=0x7fa65c0ac040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.418 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.416+0000 7fa6527fc700 1 -- 172.21.15.139:0/2876918489 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c35fb293-3e16-41e8-85f3-768e11e55b83", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa654006680 con 0x7fa65c0abad0 2020-02-12T14:12:21.418 INFO:teuthology.orchestra.run.smithi139.stdout:2 2020-02-12T14:12:21.419 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.417+0000 7fa6621bd700 1 -- 172.21.15.139:0/2876918489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa65c0abad0 msgr2=0x7fa65c13b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:21.419 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.417+0000 7fa6621bd700 1 --2- 172.21.15.139:0/2876918489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa65c0abad0 0x7fa65c13b4d0 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7fa6540032b0 tx=0x7fa65c0ac040).stop 2020-02-12T14:12:21.419 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.417+0000 7fa6621bd700 1 -- 172.21.15.139:0/2876918489 shutdown_connections 2020-02-12T14:12:21.419 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.417+0000 7fa6621bd700 1 --2- 172.21.15.139:0/2876918489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa65c0abad0 0x7fa65c13b4d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:21.420 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.417+0000 7fa6621bd700 1 --2- 172.21.15.139:0/2876918489 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa65c0a30a0 0x7fa65c07d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:21.420 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.417+0000 7fa6621bd700 1 -- 172.21.15.139:0/2876918489 >> 172.21.15.139:0/2876918489 conn(0x7fa65c05f970 msgr2=0x7fa65c09b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:21.420 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.417+0000 7fa6621bd700 1 -- 172.21.15.139:0/2876918489 shutdown_connections 2020-02-12T14:12:21.420 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.417+0000 7fa6621bd700 1 -- 172.21.15.139:0/2876918489 wait complete. 2020-02-12T14:12:21.428 INFO:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new bc8b2c0d-e3dd-48cb-883e-6ea965aee923 3 2020-02-12T14:12:21.538 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.531+0000 7fac14223700 1 Processor -- start 2020-02-12T14:12:21.538 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.531+0000 7fac14223700 1 -- start start 2020-02-12T14:12:21.538 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.531+0000 7fac14223700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac0c0a4140 0x7fac0c0a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:21.539 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.531+0000 7fac14223700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fac0c07fc00 0x7fac0c0a6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:21.539 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.531+0000 7fac14223700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0c09a700 con 0x7fac0c0a6ae0 2020-02-12T14:12:21.539 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.531+0000 7fac14223700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac0c0a5520 con 0x7fac0c07fc00 2020-02-12T14:12:21.539 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.531+0000 7fac14223700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c0a57c0 con 0x7fac0c0a4140 2020-02-12T14:12:21.539 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.532+0000 7fac12fc1700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fac0c0a6ae0 0x7fac0c0a1ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:34724/0 (socket says 172.21.15.139:34724) 2020-02-12T14:12:21.539 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.532+0000 7fac12fc1700 1 -- 172.21.15.139:0/2094362893 learned_addr learned my addr 172.21.15.139:0/2094362893 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:21.540 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.532+0000 7fac127c0700 1 --2- 172.21.15.139:0/2094362893 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac0c0a4140 0x7fac0c0a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:21.540 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.532+0000 7fac11fbf700 1 --2- 172.21.15.139:0/2094362893 >> v2:172.21.15.72:3300/0 conn(0x7fac0c07fc00 0x7fac0c0a6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:21.540 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.532+0000 7fac117be700 1 -- 172.21.15.139:0/2094362893 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 323646406 0 0) 0x7fac0c09a700 con 0x7fac0c0a6ae0 2020-02-12T14:12:21.540 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.532+0000 7fac117be700 1 -- 172.21.15.139:0/2094362893 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabf8003230 con 0x7fac0c0a6ae0 2020-02-12T14:12:21.540 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.532+0000 7fac127c0700 1 -- 172.21.15.139:0/2094362893 >> v2:172.21.15.72:3300/0 conn(0x7fac0c07fc00 msgr2=0x7fac0c0a6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:21.540 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.532+0000 7fac127c0700 1 --2- 172.21.15.139:0/2094362893 >> v2:172.21.15.72:3300/0 conn(0x7fac0c07fc00 0x7fac0c0a6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:21.540 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.532+0000 7fac127c0700 1 -- 172.21.15.139:0/2094362893 >> v1:172.21.15.139:6789/0 conn(0x7fac0c0a6ae0 legacy=0x7fac0c0a1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:21.541 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.532+0000 7fac127c0700 1 -- 172.21.15.139:0/2094362893 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c0a6f90 con 0x7fac0c0a4140 2020-02-12T14:12:21.541 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.532+0000 7fac127c0700 1 --2- 172.21.15.139:0/2094362893 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac0c0a4140 0x7fac0c0a4fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fac08002f30 tx=0x7fac080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.541 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.532+0000 7fac127c0700 1 --2- 172.21.15.139:0/2094362893 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac0c0a4140 0x7fac0c0a4fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fac08002f30 tx=0x7fac080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.541 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.532+0000 7fac127c0700 1 --2- 172.21.15.139:0/2094362893 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac0c0a4140 0x7fac0c0a4fd0 secure :-1 s=READY pgs=7 cs=0 l=1 rx=0x7fac08002f30 tx=0x7fac080088e0).ready entity=mon.2 client_cookie=ce055681c8d2eb65 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:21.541 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.532+0000 7fac127c0700 1 --2- 172.21.15.139:0/2094362893 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac0c0a4140 0x7fac0c0a4fd0 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7fac08002f30 tx=0x7fac080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.541 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.532+0000 7fac117be700 1 -- 172.21.15.139:0/2094362893 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac08008e40 con 0x7fac0c0a4140 2020-02-12T14:12:21.541 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.532+0000 7fac127c0700 1 --2- 172.21.15.139:0/2094362893 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac0c0a4140 0x7fac0c0a4fd0 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7fac08002f30 tx=0x7fac080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.542 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.532+0000 7fac127c0700 1 --2- 172.21.15.139:0/2094362893 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac0c0a4140 0x7fac0c0a4fd0 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7fac08002f30 tx=0x7fac080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.542 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.532+0000 7fac117be700 1 -- 172.21.15.139:0/2094362893 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac08011540 con 0x7fac0c0a4140 2020-02-12T14:12:21.542 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.532+0000 7fac117be700 1 -- 172.21.15.139:0/2094362893 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac08011920 con 0x7fac0c0a4140 2020-02-12T14:12:21.542 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.532+0000 7fac14223700 1 -- 172.21.15.139:0/2094362893 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac0c0a4140 msgr2=0x7fac0c0a4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:21.542 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.532+0000 7fac14223700 1 --2- 172.21.15.139:0/2094362893 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac0c0a4140 0x7fac0c0a4fd0 secure :-1 s=READY pgs=7 cs=0 l=1 rx=0x7fac08002f30 tx=0x7fac080088e0).stop 2020-02-12T14:12:21.542 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.533+0000 7fac14223700 1 -- 172.21.15.139:0/2094362893 shutdown_connections 2020-02-12T14:12:21.542 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.533+0000 7fac14223700 1 --2- 172.21.15.139:0/2094362893 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac0c0a4140 0x7fac0c0a4fd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:21.542 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.533+0000 7fac14223700 1 --2- 172.21.15.139:0/2094362893 >> v2:172.21.15.72:3300/0 conn(0x7fac0c07fc00 0x7fac0c0a6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:21.543 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.533+0000 7fac14223700 1 -- 172.21.15.139:0/2094362893 >> 172.21.15.139:0/2094362893 conn(0x7fac0c05a720 msgr2=0x7fac0c05ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:21.543 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.533+0000 7fac14223700 1 -- 172.21.15.139:0/2094362893 shutdown_connections 2020-02-12T14:12:21.543 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.533+0000 7fac14223700 1 -- 172.21.15.139:0/2094362893 wait complete. 2020-02-12T14:12:21.543 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.534+0000 7fac14223700 1 Processor -- start 2020-02-12T14:12:21.543 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.534+0000 7fac14223700 1 -- start start 2020-02-12T14:12:21.543 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.534+0000 7fac14223700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fac0c07fc00 0x7fac0c126590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:21.543 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.534+0000 7fac14223700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fac0c0a6ae0 0x7fac0c07e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:21.544 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.534+0000 7fac14223700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0c099ee0 con 0x7fac0c0a4140 2020-02-12T14:12:21.544 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.534+0000 7fac14223700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac0c1243c0 con 0x7fac0c07fc00 2020-02-12T14:12:21.544 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.534+0000 7fac14223700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac0c124660 con 0x7fac0c0a6ae0 2020-02-12T14:12:21.544 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.535+0000 7fac12fc1700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fac0c0a6ae0 0x7fac0c07e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:21.544 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.535+0000 7fac12fc1700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fac0c0a6ae0 0x7fac0c07e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46094/0 (socket says 172.21.15.139:46094) 2020-02-12T14:12:21.544 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.535+0000 7fac12fc1700 1 -- 172.21.15.139:0/2249223387 learned_addr learned my addr 172.21.15.139:0/2249223387 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:21.545 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.535+0000 7fac127c0700 1 --2- 172.21.15.139:0/2249223387 >> v2:172.21.15.72:3300/0 conn(0x7fac0c07fc00 0x7fac0c126590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:21.545 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.535+0000 7fac127c0700 1 -- 172.21.15.139:0/2249223387 >> v2:172.21.15.139:3300/0 conn(0x7fac0c0a6ae0 msgr2=0x7fac0c07e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:21.545 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.535+0000 7fac127c0700 1 --2- 172.21.15.139:0/2249223387 >> v2:172.21.15.139:3300/0 conn(0x7fac0c0a6ae0 0x7fac0c07e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:21.545 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.535+0000 7fac127c0700 1 -- 172.21.15.139:0/2249223387 >> v1:172.21.15.72:6789/0 conn(0x7fac0c0a4140 legacy=0x7fac0c1212f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:21.545 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.535+0000 7fac02ffd700 1 -- 172.21.15.139:0/2249223387 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1766548856 0 0) 0x7fac0c099ee0 con 0x7fac0c0a4140 2020-02-12T14:12:21.545 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.535+0000 7fac127c0700 1 -- 172.21.15.139:0/2249223387 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c124900 con 0x7fac0c07fc00 2020-02-12T14:12:21.546 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.535+0000 7fac127c0700 1 --2- 172.21.15.139:0/2249223387 >> v2:172.21.15.72:3300/0 conn(0x7fac0c07fc00 0x7fac0c126590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fac08002f30 tx=0x7fac0c0a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.546 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.535+0000 7fac127c0700 1 --2- 172.21.15.139:0/2249223387 >> v2:172.21.15.72:3300/0 conn(0x7fac0c07fc00 0x7fac0c126590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fac08002f30 tx=0x7fac0c0a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.546 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.535+0000 7fac127c0700 1 --2- 172.21.15.139:0/2249223387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac0c07fc00 0x7fac0c126590 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7fac08002f30 tx=0x7fac0c0a4520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:21.546 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.535+0000 7fac127c0700 1 --2- 172.21.15.139:0/2249223387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac0c07fc00 0x7fac0c126590 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fac08002f30 tx=0x7fac0c0a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.546 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.535+0000 7fac02ffd700 1 -- 172.21.15.139:0/2249223387 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac080117d0 con 0x7fac0c07fc00 2020-02-12T14:12:21.546 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.535+0000 7fac127c0700 1 --2- 172.21.15.139:0/2249223387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac0c07fc00 0x7fac0c126590 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fac08002f30 tx=0x7fac0c0a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.546 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.535+0000 7fac127c0700 1 --2- 172.21.15.139:0/2249223387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac0c07fc00 0x7fac0c126590 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fac08002f30 tx=0x7fac0c0a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.547 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.535+0000 7fac02ffd700 1 -- 172.21.15.139:0/2249223387 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac08011930 con 0x7fac0c07fc00 2020-02-12T14:12:21.547 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.535+0000 7fac14223700 1 -- 172.21.15.139:0/2249223387 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0c1223a0 con 0x7fac0c07fc00 2020-02-12T14:12:21.547 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.535+0000 7fac02ffd700 1 -- 172.21.15.139:0/2249223387 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac08007340 con 0x7fac0c07fc00 2020-02-12T14:12:21.547 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.535+0000 7fac14223700 1 -- 172.21.15.139:0/2249223387 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0c09ffe0 con 0x7fac0c07fc00 2020-02-12T14:12:21.547 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.535+0000 7fac127c0700 1 --2- 172.21.15.139:0/2249223387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac0c07fc00 0x7fac0c126590 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fac08002f30 tx=0x7fac0c0a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.547 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.536+0000 7fac02ffd700 1 -- 172.21.15.139:0/2249223387 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 2) v1 ==== 22494+0+0 (secure 0 0 0) 0x7fac080056c0 con 0x7fac0c07fc00 2020-02-12T14:12:21.547 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.536+0000 7fac127c0700 1 --2- 172.21.15.139:0/2249223387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac0c07fc00 0x7fac0c126590 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fac08002f30 tx=0x7fac0c0a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.548 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.536+0000 7fac02ffd700 1 -- 172.21.15.139:0/2249223387 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7fac080291a0 con 0x7fac0c07fc00 2020-02-12T14:12:21.548 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.536+0000 7fac14223700 1 -- 172.21.15.139:0/2249223387 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac0c0a0290 con 0x7fac0c07fc00 2020-02-12T14:12:21.548 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.538+0000 7fac127c0700 1 --2- 172.21.15.139:0/2249223387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac0c07fc00 0x7fac0c126590 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fac08002f30 tx=0x7fac0c0a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.548 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.538+0000 7fac02ffd700 1 -- 172.21.15.139:0/2249223387 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67678 (secure 0 0 0) 0x7fac08005950 con 0x7fac0c07fc00 2020-02-12T14:12:21.624 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.623+0000 7fac14223700 1 -- 172.21.15.139:0/2249223387 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bc8b2c0d-e3dd-48cb-883e-6ea965aee923", "id": 3} v 0) v1 -- 0x7fac0c067e20 con 0x7fac0c07fc00 2020-02-12T14:12:21.629 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.627+0000 7fac127c0700 1 --2- 172.21.15.139:0/2249223387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac0c07fc00 0x7fac0c126590 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fac08002f30 tx=0x7fac0c0a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.629 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.627+0000 7fac02ffd700 1 -- 172.21.15.139:0/2249223387 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bc8b2c0d-e3dd-48cb-883e-6ea965aee923", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fac080090c0 con 0x7fac0c07fc00 2020-02-12T14:12:21.629 INFO:teuthology.orchestra.run.smithi139.stdout:3 2020-02-12T14:12:21.630 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.628+0000 7fac14223700 1 -- 172.21.15.139:0/2249223387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac0c07fc00 msgr2=0x7fac0c126590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:21.631 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.628+0000 7fac14223700 1 --2- 172.21.15.139:0/2249223387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac0c07fc00 0x7fac0c126590 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7fac08002f30 tx=0x7fac0c0a4520).stop 2020-02-12T14:12:21.631 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.628+0000 7fac14223700 1 -- 172.21.15.139:0/2249223387 shutdown_connections 2020-02-12T14:12:21.631 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.628+0000 7fac14223700 1 --2- 172.21.15.139:0/2249223387 >> v2:172.21.15.139:3300/0 conn(0x7fac0c0a6ae0 0x7fac0c07e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:21.631 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.628+0000 7fac14223700 1 --2- 172.21.15.139:0/2249223387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac0c07fc00 0x7fac0c126590 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:21.631 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.628+0000 7fac14223700 1 -- 172.21.15.139:0/2249223387 >> 172.21.15.139:0/2249223387 conn(0x7fac0c05a720 msgr2=0x7fac0c05e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:21.632 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.628+0000 7fac14223700 1 -- 172.21.15.139:0/2249223387 shutdown_connections 2020-02-12T14:12:21.632 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.628+0000 7fac14223700 1 -- 172.21.15.139:0/2249223387 wait complete. 2020-02-12T14:12:21.639 INFO:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new aadfc406-0c40-4b6b-9e19-c92b2f40264a 4 2020-02-12T14:12:21.749 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.741+0000 7f16b3ec1700 1 Processor -- start 2020-02-12T14:12:21.749 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.741+0000 7f16b3ec1700 1 -- start start 2020-02-12T14:12:21.749 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.742+0000 7f16b3ec1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f16ac0a4140 0x7f16ac0a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:21.749 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.742+0000 7f16b3ec1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16ac07fc00 0x7f16ac0a6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:21.750 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.742+0000 7f16b3ec1700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ac09a700 con 0x7f16ac0a6ae0 2020-02-12T14:12:21.750 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.742+0000 7f16b3ec1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16ac0a5520 con 0x7f16ac0a4140 2020-02-12T14:12:21.750 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.742+0000 7f16b3ec1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac0a57c0 con 0x7f16ac07fc00 2020-02-12T14:12:21.750 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.742+0000 7f16b2c5f700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f16ac0a6ae0 0x7f16ac0a1ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:34734/0 (socket says 172.21.15.139:34734) 2020-02-12T14:12:21.750 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.742+0000 7f16b2c5f700 1 -- 172.21.15.139:0/2560070718 learned_addr learned my addr 172.21.15.139:0/2560070718 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:21.750 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.742+0000 7f16b245e700 1 --2- 172.21.15.139:0/2560070718 >> v2:172.21.15.72:3300/0 conn(0x7f16ac0a4140 0x7f16ac0a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:21.750 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.742+0000 7f16b1c5d700 1 --2- 172.21.15.139:0/2560070718 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16ac07fc00 0x7f16ac0a6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:21.751 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.742+0000 7f16b145c700 1 -- 172.21.15.139:0/2560070718 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2789031505 0 0) 0x7f16ac09a700 con 0x7f16ac0a6ae0 2020-02-12T14:12:21.751 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.742+0000 7f16b145c700 1 -- 172.21.15.139:0/2560070718 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1698003230 con 0x7f16ac0a6ae0 2020-02-12T14:12:21.751 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.742+0000 7f16b245e700 1 -- 172.21.15.139:0/2560070718 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16ac07fc00 msgr2=0x7f16ac0a6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:21.751 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.742+0000 7f16b245e700 1 --2- 172.21.15.139:0/2560070718 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16ac07fc00 0x7f16ac0a6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:21.751 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.742+0000 7f16b245e700 1 -- 172.21.15.139:0/2560070718 >> v1:172.21.15.139:6789/0 conn(0x7f16ac0a6ae0 legacy=0x7f16ac0a1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:21.752 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.742+0000 7f16b145c700 1 -- 172.21.15.139:0/2560070718 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2286241808 0 0) 0x7f1698003230 con 0x7f16ac0a6ae0 2020-02-12T14:12:21.752 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.743+0000 7f16b245e700 1 -- 172.21.15.139:0/2560070718 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ac0a6f90 con 0x7f16ac0a4140 2020-02-12T14:12:21.752 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.743+0000 7f16b245e700 1 --2- 172.21.15.139:0/2560070718 >> v2:172.21.15.72:3300/0 conn(0x7f16ac0a4140 0x7f16ac0a4fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f16a4001bf0 tx=0x7f16a80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.752 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.743+0000 7f16b245e700 1 --2- 172.21.15.139:0/2560070718 >> v2:172.21.15.72:3300/0 conn(0x7f16ac0a4140 0x7f16ac0a4fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f16a4001bf0 tx=0x7f16a80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.752 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.743+0000 7f16b245e700 1 --2- 172.21.15.139:0/2560070718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16ac0a4140 0x7f16ac0a4fd0 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f16a4001bf0 tx=0x7f16a80088e0).ready entity=mon.0 client_cookie=280852055460f0ce server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:21.752 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.743+0000 7f16b245e700 1 --2- 172.21.15.139:0/2560070718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16ac0a4140 0x7f16ac0a4fd0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f16a4001bf0 tx=0x7f16a80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.752 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.743+0000 7f16b145c700 1 -- 172.21.15.139:0/2560070718 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16a4001a50 con 0x7f16ac0a4140 2020-02-12T14:12:21.753 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.743+0000 7f16b245e700 1 --2- 172.21.15.139:0/2560070718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16ac0a4140 0x7f16ac0a4fd0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f16a4001bf0 tx=0x7f16a80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.753 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.743+0000 7f16b245e700 1 --2- 172.21.15.139:0/2560070718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16ac0a4140 0x7f16ac0a4fd0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f16a4001bf0 tx=0x7f16a80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.753 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.743+0000 7f16b145c700 1 -- 172.21.15.139:0/2560070718 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a8008e40 con 0x7f16ac0a4140 2020-02-12T14:12:21.753 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.743+0000 7f16b145c700 1 -- 172.21.15.139:0/2560070718 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16a8011400 con 0x7f16ac0a4140 2020-02-12T14:12:21.753 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.743+0000 7f16b3ec1700 1 -- 172.21.15.139:0/2560070718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16ac0a4140 msgr2=0x7f16ac0a4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:21.753 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.743+0000 7f16b3ec1700 1 --2- 172.21.15.139:0/2560070718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16ac0a4140 0x7f16ac0a4fd0 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f16a4001bf0 tx=0x7f16a80088e0).stop 2020-02-12T14:12:21.753 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.743+0000 7f16b3ec1700 1 -- 172.21.15.139:0/2560070718 shutdown_connections 2020-02-12T14:12:21.754 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.743+0000 7f16b3ec1700 1 --2- 172.21.15.139:0/2560070718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16ac0a4140 0x7f16ac0a4fd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:21.754 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.743+0000 7f16b3ec1700 1 --2- 172.21.15.139:0/2560070718 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16ac07fc00 0x7f16ac0a6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:21.754 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.743+0000 7f16b3ec1700 1 -- 172.21.15.139:0/2560070718 >> 172.21.15.139:0/2560070718 conn(0x7f16ac05a720 msgr2=0x7f16ac05ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:21.754 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.743+0000 7f16b3ec1700 1 -- 172.21.15.139:0/2560070718 shutdown_connections 2020-02-12T14:12:21.754 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.743+0000 7f16b3ec1700 1 -- 172.21.15.139:0/2560070718 wait complete. 2020-02-12T14:12:21.754 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.744+0000 7f16b3ec1700 1 Processor -- start 2020-02-12T14:12:21.754 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.744+0000 7f16b3ec1700 1 -- start start 2020-02-12T14:12:21.754 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.745+0000 7f16b3ec1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16ac0a4140 0x7f16ac07e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:21.755 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.745+0000 7f16b3ec1700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f16ac0a6ae0 0x7f16ac07ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:21.755 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.745+0000 7f16b3ec1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ac131ec0 con 0x7f16ac07fc00 2020-02-12T14:12:21.755 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.745+0000 7f16b3ec1700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16ac062ff0 con 0x7f16ac0a6ae0 2020-02-12T14:12:21.755 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.745+0000 7f16b3ec1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac07eeb0 con 0x7f16ac0a4140 2020-02-12T14:12:21.755 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.745+0000 7f16b2c5f700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f16ac0a6ae0 0x7f16ac07ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:21.755 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.745+0000 7f16b2c5f700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f16ac0a6ae0 0x7f16ac07ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46104/0 (socket says 172.21.15.139:46104) 2020-02-12T14:12:21.755 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.745+0000 7f16b2c5f700 1 -- 172.21.15.139:0/1490436897 learned_addr learned my addr 172.21.15.139:0/1490436897 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:21.756 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.745+0000 7f16b1c5d700 1 --2- 172.21.15.139:0/1490436897 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16ac0a4140 0x7f16ac07e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:21.756 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.745+0000 7f16b2c5f700 1 -- 172.21.15.139:0/1490436897 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16ac0a4140 msgr2=0x7f16ac07e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:21.756 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.745+0000 7f16b2c5f700 1 --2- 172.21.15.139:0/1490436897 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16ac0a4140 0x7f16ac07e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:21.756 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.745+0000 7f16b2c5f700 1 -- 172.21.15.139:0/1490436897 >> v1:172.21.15.72:6789/0 conn(0x7f16ac07fc00 legacy=0x7f16ac1315e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:21.756 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.745+0000 7f16a2ffd700 1 -- 172.21.15.139:0/1490436897 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380887201 0 0) 0x7f16ac131ec0 con 0x7f16ac07fc00 2020-02-12T14:12:21.756 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.745+0000 7f16b2c5f700 1 -- 172.21.15.139:0/1490436897 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ac0671e0 con 0x7f16ac0a6ae0 2020-02-12T14:12:21.756 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.745+0000 7f16b2c5f700 1 --2- 172.21.15.139:0/1490436897 >> v2:172.21.15.139:3300/0 conn(0x7f16ac0a6ae0 0x7f16ac07ea50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f16a4001cb0 tx=0x7f16a4010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.756 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.745+0000 7f16b2c5f700 1 --2- 172.21.15.139:0/1490436897 >> v2:172.21.15.139:3300/0 conn(0x7f16ac0a6ae0 0x7f16ac07ea50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f16a4001cb0 tx=0x7f16a4010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.757 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.745+0000 7f16b2c5f700 1 --2- 172.21.15.139:0/1490436897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16ac0a6ae0 0x7f16ac07ea50 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f16a4001cb0 tx=0x7f16a4010fa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:21.757 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.746+0000 7f16b2c5f700 1 --2- 172.21.15.139:0/1490436897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16ac0a6ae0 0x7f16ac07ea50 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f16a4001cb0 tx=0x7f16a4010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.757 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.746+0000 7f16a2ffd700 1 -- 172.21.15.139:0/1490436897 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16a4012d20 con 0x7f16ac0a6ae0 2020-02-12T14:12:21.757 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.746+0000 7f16b2c5f700 1 --2- 172.21.15.139:0/1490436897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16ac0a6ae0 0x7f16ac07ea50 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f16a4001cb0 tx=0x7f16a4010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.757 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.746+0000 7f16b2c5f700 1 --2- 172.21.15.139:0/1490436897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16ac0a6ae0 0x7f16ac07ea50 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f16a4001cb0 tx=0x7f16a4010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.757 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.746+0000 7f16a2ffd700 1 -- 172.21.15.139:0/1490436897 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a4012e80 con 0x7f16ac0a6ae0 2020-02-12T14:12:21.757 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.746+0000 7f16b3ec1700 1 -- 172.21.15.139:0/1490436897 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ac09d8c0 con 0x7f16ac0a6ae0 2020-02-12T14:12:21.758 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.746+0000 7f16a2ffd700 1 -- 172.21.15.139:0/1490436897 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16a400cae0 con 0x7f16ac0a6ae0 2020-02-12T14:12:21.758 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.746+0000 7f16b3ec1700 1 -- 172.21.15.139:0/1490436897 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ac0636d0 con 0x7f16ac0a6ae0 2020-02-12T14:12:21.758 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.746+0000 7f16b2c5f700 1 --2- 172.21.15.139:0/1490436897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16ac0a6ae0 0x7f16ac07ea50 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f16a4001cb0 tx=0x7f16a4010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.758 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.746+0000 7f16a2ffd700 1 -- 172.21.15.139:0/1490436897 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 2) v1 ==== 22494+0+0 (secure 0 0 0) 0x7f16a400cd50 con 0x7f16ac0a6ae0 2020-02-12T14:12:21.758 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.746+0000 7f16b2c5f700 1 --2- 172.21.15.139:0/1490436897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16ac0a6ae0 0x7f16ac07ea50 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f16a4001cb0 tx=0x7f16a4010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.758 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.746+0000 7f16a2ffd700 1 -- 172.21.15.139:0/1490436897 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f16a4028c00 con 0x7f16ac0a6ae0 2020-02-12T14:12:21.758 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.747+0000 7f16b3ec1700 1 -- 172.21.15.139:0/1490436897 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16ac131cf0 con 0x7f16ac0a6ae0 2020-02-12T14:12:21.759 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.749+0000 7f16b2c5f700 1 --2- 172.21.15.139:0/1490436897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16ac0a6ae0 0x7f16ac07ea50 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f16a4001cb0 tx=0x7f16a4010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.759 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.749+0000 7f16a2ffd700 1 -- 172.21.15.139:0/1490436897 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67678 (secure 0 0 0) 0x7f16a4004870 con 0x7f16ac0a6ae0 2020-02-12T14:12:21.833 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.832+0000 7f16b3ec1700 1 -- 172.21.15.139:0/1490436897 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd new", "uuid": "aadfc406-0c40-4b6b-9e19-c92b2f40264a", "id": 4} v 0) v1 -- 0x7f16ac067e20 con 0x7f16ac0a6ae0 2020-02-12T14:12:21.839 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.838+0000 7f16b2c5f700 1 --2- 172.21.15.139:0/1490436897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16ac0a6ae0 0x7f16ac07ea50 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f16a4001cb0 tx=0x7f16a4010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.839 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.838+0000 7f16a2ffd700 1 -- 172.21.15.139:0/1490436897 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aadfc406-0c40-4b6b-9e19-c92b2f40264a", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f16a4011f10 con 0x7f16ac0a6ae0 2020-02-12T14:12:21.839 INFO:teuthology.orchestra.run.smithi139.stdout:4 2020-02-12T14:12:21.840 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.839+0000 7f16b3ec1700 1 -- 172.21.15.139:0/1490436897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16ac0a6ae0 msgr2=0x7f16ac07ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:21.840 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.839+0000 7f16b3ec1700 1 --2- 172.21.15.139:0/1490436897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16ac0a6ae0 0x7f16ac07ea50 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f16a4001cb0 tx=0x7f16a4010fa0).stop 2020-02-12T14:12:21.840 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.839+0000 7f16b3ec1700 1 -- 172.21.15.139:0/1490436897 shutdown_connections 2020-02-12T14:12:21.841 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.839+0000 7f16b3ec1700 1 --2- 172.21.15.139:0/1490436897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16ac0a6ae0 0x7f16ac07ea50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:21.841 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.839+0000 7f16b3ec1700 1 --2- 172.21.15.139:0/1490436897 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16ac0a4140 0x7f16ac07e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:21.841 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.839+0000 7f16b3ec1700 1 -- 172.21.15.139:0/1490436897 >> 172.21.15.139:0/1490436897 conn(0x7f16ac05a720 msgr2=0x7f16ac05e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:21.841 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.839+0000 7f16b3ec1700 1 -- 172.21.15.139:0/1490436897 shutdown_connections 2020-02-12T14:12:21.841 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.839+0000 7f16b3ec1700 1 -- 172.21.15.139:0/1490436897 wait complete. 2020-02-12T14:12:21.850 INFO:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new 3296dc8e-9322-4430-abd2-7672da5b7acc 5 2020-02-12T14:12:21.956 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.952+0000 7f37d52e6700 1 Processor -- start 2020-02-12T14:12:21.956 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.952+0000 7f37d52e6700 1 -- start start 2020-02-12T14:12:21.957 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.953+0000 7f37d52e6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37d00a4140 0x7f37d00a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:21.957 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.953+0000 7f37d52e6700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f37d00a6d90 0x7f37d014e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:21.957 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.953+0000 7f37d52e6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37d009a700 con 0x7f37d007fc00 2020-02-12T14:12:21.957 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.953+0000 7f37d52e6700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37d00a5520 con 0x7f37d00a6d90 2020-02-12T14:12:21.957 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.953+0000 7f37d52e6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d00a57c0 con 0x7f37d00a4140 2020-02-12T14:12:21.957 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.953+0000 7f37cffff700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f37d00a6d90 0x7f37d014e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:21.958 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.953+0000 7f37cffff700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f37d00a6d90 0x7f37d014e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46106/0 (socket says 172.21.15.139:46106) 2020-02-12T14:12:21.958 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.953+0000 7f37cffff700 1 -- 172.21.15.139:0/4175951933 learned_addr learned my addr 172.21.15.139:0/4175951933 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:21.958 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.953+0000 7f37cf7fe700 1 --2- 172.21.15.139:0/4175951933 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37d00a4140 0x7f37d00a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:21.958 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.953+0000 7f37cffff700 1 -- 172.21.15.139:0/4175951933 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37d00a4140 msgr2=0x7f37d00a4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:21.958 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.953+0000 7f37cffff700 1 --2- 172.21.15.139:0/4175951933 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37d00a4140 0x7f37d00a4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:21.958 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.953+0000 7f37cffff700 1 -- 172.21.15.139:0/4175951933 >> v1:172.21.15.72:6789/0 conn(0x7f37d007fc00 legacy=0x7f37d00a6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:21.958 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.953+0000 7f37cffff700 1 -- 172.21.15.139:0/4175951933 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d014fe00 con 0x7f37d00a6d90 2020-02-12T14:12:21.959 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.953+0000 7f37cffff700 1 --2- 172.21.15.139:0/4175951933 >> v2:172.21.15.139:3300/0 conn(0x7f37d00a6d90 0x7f37d014e990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f37c8002f30 tx=0x7f37c80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.959 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.953+0000 7f37cffff700 1 --2- 172.21.15.139:0/4175951933 >> v2:172.21.15.139:3300/0 conn(0x7f37d00a6d90 0x7f37d014e990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f37c8002f30 tx=0x7f37c80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.959 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.953+0000 7f37cffff700 1 --2- 172.21.15.139:0/4175951933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37d00a6d90 0x7f37d014e990 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f37c8002f30 tx=0x7f37c80088e0).ready entity=mon.1 client_cookie=829666e1b621732d server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:21.959 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.953+0000 7f37cffff700 1 --2- 172.21.15.139:0/4175951933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37d00a6d90 0x7f37d014e990 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f37c8002f30 tx=0x7f37c80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.959 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.953+0000 7f37ce7fc700 1 -- 172.21.15.139:0/4175951933 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37c80116b0 con 0x7f37d00a6d90 2020-02-12T14:12:21.959 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.953+0000 7f37cffff700 1 --2- 172.21.15.139:0/4175951933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37d00a6d90 0x7f37d014e990 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f37c8002f30 tx=0x7f37c80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.960 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.953+0000 7f37cffff700 1 --2- 172.21.15.139:0/4175951933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37d00a6d90 0x7f37d014e990 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f37c8002f30 tx=0x7f37c80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.960 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.953+0000 7f37ce7fc700 1 -- 172.21.15.139:0/4175951933 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c8011810 con 0x7f37d00a6d90 2020-02-12T14:12:21.960 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.953+0000 7f37ce7fc700 1 -- 172.21.15.139:0/4175951933 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37c8011bf0 con 0x7f37d00a6d90 2020-02-12T14:12:21.960 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.954+0000 7f37d52e6700 1 -- 172.21.15.139:0/4175951933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37d00a6d90 msgr2=0x7f37d014e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:21.960 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.954+0000 7f37d52e6700 1 --2- 172.21.15.139:0/4175951933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37d00a6d90 0x7f37d014e990 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f37c8002f30 tx=0x7f37c80088e0).stop 2020-02-12T14:12:21.960 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.954+0000 7f37d52e6700 1 -- 172.21.15.139:0/4175951933 shutdown_connections 2020-02-12T14:12:21.960 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.954+0000 7f37d52e6700 1 --2- 172.21.15.139:0/4175951933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37d00a6d90 0x7f37d014e990 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:21.961 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.954+0000 7f37d52e6700 1 --2- 172.21.15.139:0/4175951933 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37d00a4140 0x7f37d00a4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:21.961 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.954+0000 7f37d52e6700 1 -- 172.21.15.139:0/4175951933 >> 172.21.15.139:0/4175951933 conn(0x7f37d005a720 msgr2=0x7f37d005ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:21.961 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.954+0000 7f37d52e6700 1 -- 172.21.15.139:0/4175951933 shutdown_connections 2020-02-12T14:12:21.961 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.954+0000 7f37d52e6700 1 -- 172.21.15.139:0/4175951933 wait complete. 2020-02-12T14:12:21.961 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.955+0000 7f37d52e6700 1 Processor -- start 2020-02-12T14:12:21.961 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.955+0000 7f37d52e6700 1 -- start start 2020-02-12T14:12:21.964 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.956+0000 7f37d52e6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f37d00a6d90 0x7f37d0128cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:21.964 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.956+0000 7f37d52e6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37d0128870 con 0x7f37d007fc00 2020-02-12T14:12:21.965 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.956+0000 7f37d52e6700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37d0124d00 con 0x7f37d00a4140 2020-02-12T14:12:21.965 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.956+0000 7f37d52e6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37d007f550 con 0x7f37d00a6d90 2020-02-12T14:12:21.965 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.956+0000 7f37ceffd700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f37d00a4140 0x7f37d013ccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:34750/0 (socket says 172.21.15.139:34750) 2020-02-12T14:12:21.965 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.956+0000 7f37ceffd700 1 -- 172.21.15.139:0/1156679454 learned_addr learned my addr 172.21.15.139:0/1156679454 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:21.965 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.956+0000 7f37cffff700 1 --2- 172.21.15.139:0/1156679454 >> v2:172.21.15.72:3300/0 conn(0x7f37d00a6d90 0x7f37d0128cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:21.966 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.956+0000 7f37b7fff700 1 -- 172.21.15.139:0/1156679454 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3995663785 0 0) 0x7f37d0124d00 con 0x7f37d00a4140 2020-02-12T14:12:21.966 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.956+0000 7f37b7fff700 1 -- 172.21.15.139:0/1156679454 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37b0003230 con 0x7f37d00a4140 2020-02-12T14:12:21.966 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.956+0000 7f37b7fff700 1 -- 172.21.15.139:0/1156679454 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1825218498 0 0) 0x7f37b0003230 con 0x7f37d00a4140 2020-02-12T14:12:21.966 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.956+0000 7f37cffff700 1 -- 172.21.15.139:0/1156679454 >> v1:172.21.15.139:6789/0 conn(0x7f37d00a4140 legacy=0x7f37d013ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:21.966 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.956+0000 7f37cffff700 1 -- 172.21.15.139:0/1156679454 >> v1:172.21.15.72:6789/0 conn(0x7f37d007fc00 legacy=0x7f37d007e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:21.966 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.956+0000 7f37cffff700 1 -- 172.21.15.139:0/1156679454 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d0127090 con 0x7f37d00a6d90 2020-02-12T14:12:21.966 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.956+0000 7f37cffff700 1 --2- 172.21.15.139:0/1156679454 >> v2:172.21.15.72:3300/0 conn(0x7f37d00a6d90 0x7f37d0128cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f37c0003270 tx=0x7f37d00a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.967 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.956+0000 7f37cffff700 1 --2- 172.21.15.139:0/1156679454 >> v2:172.21.15.72:3300/0 conn(0x7f37d00a6d90 0x7f37d0128cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f37c0003270 tx=0x7f37d00a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.967 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.956+0000 7f37cffff700 1 --2- 172.21.15.139:0/1156679454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37d00a6d90 0x7f37d0128cd0 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7f37c0003270 tx=0x7f37d00a4520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:21.967 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.957+0000 7f37cffff700 1 --2- 172.21.15.139:0/1156679454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37d00a6d90 0x7f37d0128cd0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f37c0003270 tx=0x7f37d00a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.967 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.957+0000 7f37b7fff700 1 -- 172.21.15.139:0/1156679454 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37c40019c0 con 0x7f37d00a6d90 2020-02-12T14:12:21.967 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.957+0000 7f37cffff700 1 --2- 172.21.15.139:0/1156679454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37d00a6d90 0x7f37d0128cd0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f37c0003270 tx=0x7f37d00a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.967 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.957+0000 7f37cffff700 1 --2- 172.21.15.139:0/1156679454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37d00a6d90 0x7f37d0128cd0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f37c0003270 tx=0x7f37d00a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.968 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.957+0000 7f37b7fff700 1 -- 172.21.15.139:0/1156679454 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c8011e60 con 0x7f37d00a6d90 2020-02-12T14:12:21.968 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.957+0000 7f37d52e6700 1 -- 172.21.15.139:0/1156679454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37d0126960 con 0x7f37d00a6d90 2020-02-12T14:12:21.968 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.957+0000 7f37b7fff700 1 -- 172.21.15.139:0/1156679454 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37c8007150 con 0x7f37d00a6d90 2020-02-12T14:12:21.968 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.957+0000 7f37d52e6700 1 -- 172.21.15.139:0/1156679454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d01273b0 con 0x7f37d00a6d90 2020-02-12T14:12:21.968 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.957+0000 7f37cffff700 1 --2- 172.21.15.139:0/1156679454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37d00a6d90 0x7f37d0128cd0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f37c0003270 tx=0x7f37d00a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.968 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.957+0000 7f37b7fff700 1 -- 172.21.15.139:0/1156679454 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 2) v1 ==== 22494+0+0 (secure 0 0 0) 0x7f37c80073c0 con 0x7f37d00a6d90 2020-02-12T14:12:21.968 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.957+0000 7f37cffff700 1 --2- 172.21.15.139:0/1156679454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37d00a6d90 0x7f37d0128cd0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f37c0003270 tx=0x7f37d00a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.969 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.957+0000 7f37b7fff700 1 -- 172.21.15.139:0/1156679454 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7f37c8028a70 con 0x7f37d00a6d90 2020-02-12T14:12:21.969 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.958+0000 7f37d52e6700 1 -- 172.21.15.139:0/1156679454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37d0067e20 con 0x7f37d00a6d90 2020-02-12T14:12:21.969 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.960+0000 7f37cffff700 1 --2- 172.21.15.139:0/1156679454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37d00a6d90 0x7f37d0128cd0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f37c0003270 tx=0x7f37d00a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:21.969 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:21.960+0000 7f37b7fff700 1 -- 172.21.15.139:0/1156679454 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67678 (secure 0 0 0) 0x7f37c80092a0 con 0x7f37d00a6d90 2020-02-12T14:12:22.047 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.046+0000 7f37d52e6700 1 -- 172.21.15.139:0/1156679454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3296dc8e-9322-4430-abd2-7672da5b7acc", "id": 5} v 0) v1 -- 0x7f37d009d8f0 con 0x7f37d00a6d90 2020-02-12T14:12:22.050 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.049+0000 7f37cffff700 1 --2- 172.21.15.139:0/1156679454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37d00a6d90 0x7f37d0128cd0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f37c0003270 tx=0x7f37d00a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.050 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.049+0000 7f37b7fff700 1 -- 172.21.15.139:0/1156679454 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3296dc8e-9322-4430-abd2-7672da5b7acc", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f37c80090c0 con 0x7f37d00a6d90 2020-02-12T14:12:22.050 INFO:teuthology.orchestra.run.smithi139.stdout:5 2020-02-12T14:12:22.051 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.049+0000 7f37d52e6700 1 -- 172.21.15.139:0/1156679454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37d00a6d90 msgr2=0x7f37d0128cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:22.051 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.049+0000 7f37d52e6700 1 --2- 172.21.15.139:0/1156679454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37d00a6d90 0x7f37d0128cd0 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7f37c0003270 tx=0x7f37d00a4520).stop 2020-02-12T14:12:22.051 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.050+0000 7f37d52e6700 1 -- 172.21.15.139:0/1156679454 shutdown_connections 2020-02-12T14:12:22.052 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.050+0000 7f37d52e6700 1 --2- 172.21.15.139:0/1156679454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37d00a6d90 0x7f37d0128cd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:22.052 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.050+0000 7f37d52e6700 1 -- 172.21.15.139:0/1156679454 >> 172.21.15.139:0/1156679454 conn(0x7f37d005a720 msgr2=0x7f37d00a8850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:22.052 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.050+0000 7f37d52e6700 1 -- 172.21.15.139:0/1156679454 shutdown_connections 2020-02-12T14:12:22.052 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.050+0000 7f37d52e6700 1 -- 172.21.15.139:0/1156679454 wait complete. 2020-02-12T14:12:22.061 INFO:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new 7c39cf20-a3a8-4d56-8577-f4102b302a11 6 2020-02-12T14:12:22.173 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.165+0000 7f8adf0d7700 1 Processor -- start 2020-02-12T14:12:22.173 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.165+0000 7f8adf0d7700 1 -- start start 2020-02-12T14:12:22.173 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.166+0000 7f8adf0d7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ad80a4140 0x7f8ad80a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:22.174 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.166+0000 7f8adf0d7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ad807fc00 0x7f8ad80a6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:22.174 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.166+0000 7f8adf0d7700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad809a700 con 0x7f8ad80a6ae0 2020-02-12T14:12:22.174 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.166+0000 7f8adf0d7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad80a5520 con 0x7f8ad80a4140 2020-02-12T14:12:22.174 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.166+0000 7f8adf0d7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad80a57c0 con 0x7f8ad807fc00 2020-02-12T14:12:22.174 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.166+0000 7f8adde75700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f8ad80a6ae0 0x7f8ad80a1ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:34760/0 (socket says 172.21.15.139:34760) 2020-02-12T14:12:22.174 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.166+0000 7f8adde75700 1 -- 172.21.15.139:0/1607132336 learned_addr learned my addr 172.21.15.139:0/1607132336 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:22.174 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.166+0000 7f8adce73700 1 --2- 172.21.15.139:0/1607132336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ad807fc00 0x7f8ad80a6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:22.175 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.166+0000 7f8acffff700 1 -- 172.21.15.139:0/1607132336 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3863936069 0 0) 0x7f8ad809a700 con 0x7f8ad80a6ae0 2020-02-12T14:12:22.175 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.166+0000 7f8acffff700 1 -- 172.21.15.139:0/1607132336 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ac4003230 con 0x7f8ad80a6ae0 2020-02-12T14:12:22.175 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.166+0000 7f8add674700 1 --2- 172.21.15.139:0/1607132336 >> v2:172.21.15.72:3300/0 conn(0x7f8ad80a4140 0x7f8ad80a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:22.175 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.166+0000 7f8acffff700 1 -- 172.21.15.139:0/1607132336 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4053861583 0 0) 0x7f8ac4003230 con 0x7f8ad80a6ae0 2020-02-12T14:12:22.175 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.166+0000 7f8acffff700 1 -- 172.21.15.139:0/1607132336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ad807fc00 msgr2=0x7f8ad80a6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:22.175 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.166+0000 7f8acffff700 1 --2- 172.21.15.139:0/1607132336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ad807fc00 0x7f8ad80a6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:22.175 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.166+0000 7f8acffff700 1 -- 172.21.15.139:0/1607132336 >> v2:172.21.15.72:3300/0 conn(0x7f8ad80a4140 msgr2=0x7f8ad80a4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:22.176 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.166+0000 7f8acffff700 1 --2- 172.21.15.139:0/1607132336 >> v2:172.21.15.72:3300/0 conn(0x7f8ad80a4140 0x7f8ad80a4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:22.176 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.166+0000 7f8acffff700 1 -- 172.21.15.139:0/1607132336 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad80a6f90 con 0x7f8ad80a6ae0 2020-02-12T14:12:22.176 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.166+0000 7f8acffff700 1 -- 172.21.15.139:0/1607132336 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7f8ad0001a50 con 0x7f8ad80a6ae0 2020-02-12T14:12:22.176 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.166+0000 7f8acffff700 1 -- 172.21.15.139:0/1607132336 >> v1:172.21.15.139:6789/0 conn(0x7f8ad80a6ae0 legacy=0x7f8ad80a1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:22.176 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.166+0000 7f8acffff700 1 --2- 172.21.15.139:0/1607132336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ad807fc00 0x7f8ac4003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:22.176 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.166+0000 7f8acffff700 1 --2- 172.21.15.139:0/1607132336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ac4003b80 0x7f8ac4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:22.176 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.166+0000 7f8acffff700 1 --2- 172.21.15.139:0/1607132336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ac40045c0 0x7f8ac4004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:22.176 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.166+0000 7f8acffff700 1 -- 172.21.15.139:0/1607132336 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad80a5520 con 0x7f8ac4003b80 2020-02-12T14:12:22.177 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.166+0000 7f8acffff700 1 -- 172.21.15.139:0/1607132336 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad80a57c0 con 0x7f8ac40045c0 2020-02-12T14:12:22.177 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.166+0000 7f8acffff700 1 -- 172.21.15.139:0/1607132336 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac4005050 con 0x7f8ad807fc00 2020-02-12T14:12:22.177 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.167+0000 7f8adde75700 1 --2- 172.21.15.139:0/1607132336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ac40045c0 0x7f8ac4004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:22.177 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.167+0000 7f8add674700 1 --2- 172.21.15.139:0/1607132336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ad807fc00 0x7f8ac4003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:22.177 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.167+0000 7f8adce73700 1 --2- 172.21.15.139:0/1607132336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ac4003b80 0x7f8ac4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:22.177 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.167+0000 7f8adde75700 1 -- 172.21.15.139:0/1607132336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ad807fc00 msgr2=0x7f8ac4003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:22.177 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.167+0000 7f8adde75700 1 --2- 172.21.15.139:0/1607132336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ad807fc00 0x7f8ac4003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:22.178 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.167+0000 7f8adde75700 1 -- 172.21.15.139:0/1607132336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ac4003b80 msgr2=0x7f8ac4003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:22.178 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.167+0000 7f8adde75700 1 --2- 172.21.15.139:0/1607132336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ac4003b80 0x7f8ac4003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:22.178 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.167+0000 7f8adde75700 1 -- 172.21.15.139:0/1607132336 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac4003230 con 0x7f8ac40045c0 2020-02-12T14:12:22.178 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.167+0000 7f8adde75700 1 --2- 172.21.15.139:0/1607132336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ac40045c0 0x7f8ac4004a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8ad0001760 tx=0x7f8ad80a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.178 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.167+0000 7f8adde75700 1 --2- 172.21.15.139:0/1607132336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ac40045c0 0x7f8ac4004a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8ad0001760 tx=0x7f8ad80a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.178 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.167+0000 7f8adde75700 1 --2- 172.21.15.139:0/1607132336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ac40045c0 0x7f8ac4004a20 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f8ad0001760 tx=0x7f8ad80a4520).ready entity=mon.1 client_cookie=f293c1053a7f670d server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:22.178 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.167+0000 7f8adde75700 1 --2- 172.21.15.139:0/1607132336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ac40045c0 0x7f8ac4004a20 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f8ad0001760 tx=0x7f8ad80a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.178 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.167+0000 7f8adde75700 1 --2- 172.21.15.139:0/1607132336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ac40045c0 0x7f8ac4004a20 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f8ad0001760 tx=0x7f8ad80a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.179 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.167+0000 7f8acffff700 1 -- 172.21.15.139:0/1607132336 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ad0005de0 con 0x7f8ac40045c0 2020-02-12T14:12:22.179 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.167+0000 7f8adde75700 1 --2- 172.21.15.139:0/1607132336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ac40045c0 0x7f8ac4004a20 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f8ad0001760 tx=0x7f8ad80a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.179 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.167+0000 7f8acffff700 1 -- 172.21.15.139:0/1607132336 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad0004c30 con 0x7f8ac40045c0 2020-02-12T14:12:22.179 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.167+0000 7f8acffff700 1 -- 172.21.15.139:0/1607132336 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ad0004f90 con 0x7f8ac40045c0 2020-02-12T14:12:22.179 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.167+0000 7f8adf0d7700 1 -- 172.21.15.139:0/1607132336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ac40045c0 msgr2=0x7f8ac4004a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:22.179 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.167+0000 7f8adf0d7700 1 --2- 172.21.15.139:0/1607132336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ac40045c0 0x7f8ac4004a20 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f8ad0001760 tx=0x7f8ad80a4520).stop 2020-02-12T14:12:22.180 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.167+0000 7f8adde75700 1 -- 172.21.15.139:0/1607132336 reap_dead start 2020-02-12T14:12:22.180 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.167+0000 7f8adf0d7700 1 -- 172.21.15.139:0/1607132336 shutdown_connections 2020-02-12T14:12:22.180 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.167+0000 7f8adf0d7700 1 -- 172.21.15.139:0/1607132336 >> 172.21.15.139:0/1607132336 conn(0x7f8ad805a720 msgr2=0x7f8ad805ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:22.180 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.168+0000 7f8adf0d7700 1 -- 172.21.15.139:0/1607132336 shutdown_connections 2020-02-12T14:12:22.180 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.168+0000 7f8adf0d7700 1 -- 172.21.15.139:0/1607132336 wait complete. 2020-02-12T14:12:22.180 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.169+0000 7f8adf0d7700 1 Processor -- start 2020-02-12T14:12:22.180 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.169+0000 7f8adf0d7700 1 -- start start 2020-02-12T14:12:22.180 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.169+0000 7f8adf0d7700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8ad8066010 0x7f8ad8063090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:22.181 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.169+0000 7f8adf0d7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad80664b0 con 0x7f8ad8066df0 2020-02-12T14:12:22.181 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.169+0000 7f8adf0d7700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad8066750 con 0x7f8ad807e660 2020-02-12T14:12:22.181 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.169+0000 7f8adf0d7700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad80642f0 con 0x7f8ad8066010 2020-02-12T14:12:22.181 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.169+0000 7f8adce73700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8ad8066010 0x7f8ad8063090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:22.181 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.169+0000 7f8adde75700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f8ad807e660 0x7f8ad807ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:34776/0 (socket says 172.21.15.139:34776) 2020-02-12T14:12:22.181 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.169+0000 7f8adce73700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8ad8066010 0x7f8ad8063090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46136/0 (socket says 172.21.15.139:46136) 2020-02-12T14:12:22.181 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.169+0000 7f8adde75700 1 -- 172.21.15.139:0/42315022 learned_addr learned my addr 172.21.15.139:0/42315022 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:22.182 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.170+0000 7f8adce73700 1 -- 172.21.15.139:0/42315022 >> v1:172.21.15.139:6789/0 conn(0x7f8ad807e660 legacy=0x7f8ad807ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:22.182 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.170+0000 7f8adce73700 1 -- 172.21.15.139:0/42315022 >> v1:172.21.15.72:6789/0 conn(0x7f8ad8066df0 legacy=0x7f8ad8064790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:22.182 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.170+0000 7f8acdffb700 1 -- 172.21.15.139:0/42315022 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 274208284 0 0) 0x7f8ad8066750 con 0x7f8ad807e660 2020-02-12T14:12:22.182 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.170+0000 7f8adce73700 1 -- 172.21.15.139:0/42315022 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad8062540 con 0x7f8ad8066010 2020-02-12T14:12:22.182 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.170+0000 7f8adce73700 1 --2- 172.21.15.139:0/42315022 >> v2:172.21.15.139:3300/0 conn(0x7f8ad8066010 0x7f8ad8063090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8ac8002f30 tx=0x7f8ac8010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.182 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.170+0000 7f8adce73700 1 --2- 172.21.15.139:0/42315022 >> v2:172.21.15.139:3300/0 conn(0x7f8ad8066010 0x7f8ad8063090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8ac8002f30 tx=0x7f8ac8010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.182 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.170+0000 7f8adce73700 1 --2- 172.21.15.139:0/42315022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ad8066010 0x7f8ad8063090 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f8ac8002f30 tx=0x7f8ac8010b00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:22.183 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.170+0000 7f8adce73700 1 --2- 172.21.15.139:0/42315022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ad8066010 0x7f8ad8063090 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f8ac8002f30 tx=0x7f8ac8010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.183 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.170+0000 7f8acdffb700 1 -- 172.21.15.139:0/42315022 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ac8005e90 con 0x7f8ad8066010 2020-02-12T14:12:22.183 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.170+0000 7f8adce73700 1 --2- 172.21.15.139:0/42315022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ad8066010 0x7f8ad8063090 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f8ac8002f30 tx=0x7f8ac8010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.185 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.170+0000 7f8acdffb700 1 -- 172.21.15.139:0/42315022 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac8007160 con 0x7f8ad8066010 2020-02-12T14:12:22.185 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.170+0000 7f8adce73700 1 --2- 172.21.15.139:0/42315022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ad8066010 0x7f8ad8063090 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f8ac8002f30 tx=0x7f8ac8010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.185 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.170+0000 7f8acdffb700 1 -- 172.21.15.139:0/42315022 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ac8007540 con 0x7f8ad8066010 2020-02-12T14:12:22.186 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.170+0000 7f8adf0d7700 1 -- 172.21.15.139:0/42315022 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad809da10 con 0x7f8ad8066010 2020-02-12T14:12:22.186 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.170+0000 7f8adf0d7700 1 -- 172.21.15.139:0/42315022 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad813cf30 con 0x7f8ad8066010 2020-02-12T14:12:22.186 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.170+0000 7f8adce73700 1 --2- 172.21.15.139:0/42315022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ad8066010 0x7f8ad8063090 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f8ac8002f30 tx=0x7f8ac8010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.186 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.171+0000 7f8adce73700 1 --2- 172.21.15.139:0/42315022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ad8066010 0x7f8ad8063090 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f8ac8002f30 tx=0x7f8ac8010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.186 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.171+0000 7f8acdffb700 1 -- 172.21.15.139:0/42315022 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 3) v1 ==== 45077+0+0 (secure 0 0 0) 0x7f8ac8013060 con 0x7f8ad8066010 2020-02-12T14:12:22.186 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.171+0000 7f8adf0d7700 1 -- 172.21.15.139:0/42315022 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad8067e20 con 0x7f8ad8066010 2020-02-12T14:12:22.186 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.171+0000 7f8acdffb700 1 --2- 172.21.15.139:0/42315022 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f8ab8039a90 0x7f8ab803bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:22.187 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.171+0000 7f8acdffb700 1 -- 172.21.15.139:0/42315022 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f8ac8049810 con 0x7f8ad8066010 2020-02-12T14:12:22.187 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.171+0000 7f8add674700 1 --2- 172.21.15.139:0/42315022 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f8ab8039a90 0x7f8ab803bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:22.187 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.171+0000 7f8add674700 1 --2- 172.21.15.139:0/42315022 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f8ab8039a90 0x7f8ab803bf50 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:22.188 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.175+0000 7f8adce73700 1 --2- 172.21.15.139:0/42315022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ad8066010 0x7f8ad8063090 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f8ac8002f30 tx=0x7f8ac8010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.188 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.175+0000 7f8acdffb700 1 -- 172.21.15.139:0/42315022 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f8ac802ecc0 con 0x7f8ad8066010 2020-02-12T14:12:22.326 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.325+0000 7f8adf0d7700 1 -- 172.21.15.139:0/42315022 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7c39cf20-a3a8-4d56-8577-f4102b302a11", "id": 6} v 0) v1 -- 0x7f8ad80672e0 con 0x7f8ad8066010 2020-02-12T14:12:22.330 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.329+0000 7f8adce73700 1 --2- 172.21.15.139:0/42315022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ad8066010 0x7f8ad8063090 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f8ac8002f30 tx=0x7f8ac8010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.330 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.329+0000 7f8acdffb700 1 -- 172.21.15.139:0/42315022 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7c39cf20-a3a8-4d56-8577-f4102b302a11", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8ac80319a0 con 0x7f8ad8066010 2020-02-12T14:12:22.330 INFO:teuthology.orchestra.run.smithi139.stdout:6 2020-02-12T14:12:22.332 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.330+0000 7f8adf0d7700 1 -- 172.21.15.139:0/42315022 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f8ab8039a90 msgr2=0x7f8ab803bf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:22.332 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.330+0000 7f8adf0d7700 1 --2- 172.21.15.139:0/42315022 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f8ab8039a90 0x7f8ab803bf50 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:22.332 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.330+0000 7f8adf0d7700 1 -- 172.21.15.139:0/42315022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ad8066010 msgr2=0x7f8ad8063090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:22.332 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.330+0000 7f8adf0d7700 1 --2- 172.21.15.139:0/42315022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ad8066010 0x7f8ad8063090 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f8ac8002f30 tx=0x7f8ac8010b00).stop 2020-02-12T14:12:22.332 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.330+0000 7f8adf0d7700 1 -- 172.21.15.139:0/42315022 shutdown_connections 2020-02-12T14:12:22.332 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.330+0000 7f8adf0d7700 1 --2- 172.21.15.139:0/42315022 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f8ab8039a90 0x7f8ab803bf50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:22.333 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.330+0000 7f8adf0d7700 1 --2- 172.21.15.139:0/42315022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ad8066010 0x7f8ad8063090 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:22.333 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.330+0000 7f8adf0d7700 1 -- 172.21.15.139:0/42315022 >> 172.21.15.139:0/42315022 conn(0x7f8ad805a720 msgr2=0x7f8ad805e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:22.333 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.330+0000 7f8adf0d7700 1 -- 172.21.15.139:0/42315022 shutdown_connections 2020-02-12T14:12:22.333 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.330+0000 7f8adf0d7700 1 -- 172.21.15.139:0/42315022 wait complete. 2020-02-12T14:12:22.342 INFO:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new f452adff-8432-47e9-a5f1-9fd7e2a04a92 7 2020-02-12T14:12:22.448 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.444+0000 7f5aa41a9700 1 Processor -- start 2020-02-12T14:12:22.448 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.444+0000 7f5aa41a9700 1 -- start start 2020-02-12T14:12:22.448 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.445+0000 7f5aa41a9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a9c07fc00 0x7f5a9c0a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:22.449 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.445+0000 7f5aa41a9700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f5a9c0a6d90 0x7f5a9c14e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:22.449 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.445+0000 7f5aa41a9700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9c09a700 con 0x7f5a9c0a4140 2020-02-12T14:12:22.449 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.445+0000 7f5aa41a9700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a9c0a5520 con 0x7f5a9c0a6d90 2020-02-12T14:12:22.449 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.445+0000 7f5aa41a9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c0a57c0 con 0x7f5a9c07fc00 2020-02-12T14:12:22.449 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.445+0000 7f5aa2f47700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f5a9c0a6d90 0x7f5a9c14e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:22.449 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.445+0000 7f5aa2f47700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f5a9c0a6d90 0x7f5a9c14e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46142/0 (socket says 172.21.15.139:46142) 2020-02-12T14:12:22.450 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.445+0000 7f5aa2f47700 1 -- 172.21.15.139:0/4018633574 learned_addr learned my addr 172.21.15.139:0/4018633574 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:22.450 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.445+0000 7f5aa2746700 1 --1- 172.21.15.139:0/4018633574 >> v1:172.21.15.139:6789/0 conn(0x7f5a9c0a4140 0x7f5a9c0a6680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:34780/0 (socket says 172.21.15.139:34780) 2020-02-12T14:12:22.450 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.445+0000 7f5aa1f45700 1 --2- 172.21.15.139:0/4018633574 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a9c07fc00 0x7f5a9c0a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:22.450 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.445+0000 7f5aa2f47700 1 -- 172.21.15.139:0/4018633574 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a9c07fc00 msgr2=0x7f5a9c0a4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:22.450 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.445+0000 7f5aa2f47700 1 --2- 172.21.15.139:0/4018633574 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a9c07fc00 0x7f5a9c0a4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:22.450 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.445+0000 7f5aa2f47700 1 -- 172.21.15.139:0/4018633574 >> v1:172.21.15.139:6789/0 conn(0x7f5a9c0a4140 legacy=0x7f5a9c0a6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:22.450 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.445+0000 7f5aa1744700 1 -- 172.21.15.139:0/4018633574 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2379331395 0 0) 0x7f5a9c09a700 con 0x7f5a9c0a4140 2020-02-12T14:12:22.451 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.445+0000 7f5aa2f47700 1 -- 172.21.15.139:0/4018633574 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9c14fe00 con 0x7f5a9c0a6d90 2020-02-12T14:12:22.451 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.445+0000 7f5aa2f47700 1 --2- 172.21.15.139:0/4018633574 >> v2:172.21.15.139:3300/0 conn(0x7f5a9c0a6d90 0x7f5a9c14e990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5a940032b0 tx=0x7f5a94008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.451 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.445+0000 7f5aa2f47700 1 --2- 172.21.15.139:0/4018633574 >> v2:172.21.15.139:3300/0 conn(0x7f5a9c0a6d90 0x7f5a9c14e990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5a940032b0 tx=0x7f5a94008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.451 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.445+0000 7f5aa2f47700 1 --2- 172.21.15.139:0/4018633574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a9c0a6d90 0x7f5a9c14e990 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f5a940032b0 tx=0x7f5a94008c60).ready entity=mon.1 client_cookie=114cc9d74b7bf231 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:22.451 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.446+0000 7f5aa2f47700 1 --2- 172.21.15.139:0/4018633574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a9c0a6d90 0x7f5a9c14e990 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f5a940032b0 tx=0x7f5a94008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.451 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.446+0000 7f5aa1744700 1 -- 172.21.15.139:0/4018633574 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a9400a160 con 0x7f5a9c0a6d90 2020-02-12T14:12:22.451 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.446+0000 7f5aa2f47700 1 --2- 172.21.15.139:0/4018633574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a9c0a6d90 0x7f5a9c14e990 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f5a940032b0 tx=0x7f5a94008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.452 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.446+0000 7f5aa2f47700 1 --2- 172.21.15.139:0/4018633574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a9c0a6d90 0x7f5a9c14e990 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f5a940032b0 tx=0x7f5a94008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.452 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.446+0000 7f5aa1744700 1 -- 172.21.15.139:0/4018633574 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9400a2c0 con 0x7f5a9c0a6d90 2020-02-12T14:12:22.452 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.446+0000 7f5aa1744700 1 -- 172.21.15.139:0/4018633574 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a9400a660 con 0x7f5a9c0a6d90 2020-02-12T14:12:22.452 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.446+0000 7f5aa41a9700 1 -- 172.21.15.139:0/4018633574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a9c0a6d90 msgr2=0x7f5a9c14e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:22.452 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.446+0000 7f5aa41a9700 1 --2- 172.21.15.139:0/4018633574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a9c0a6d90 0x7f5a9c14e990 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f5a940032b0 tx=0x7f5a94008c60).stop 2020-02-12T14:12:22.452 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.446+0000 7f5aa41a9700 1 -- 172.21.15.139:0/4018633574 shutdown_connections 2020-02-12T14:12:22.452 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.446+0000 7f5aa41a9700 1 --2- 172.21.15.139:0/4018633574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a9c0a6d90 0x7f5a9c14e990 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:22.452 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.446+0000 7f5aa41a9700 1 --2- 172.21.15.139:0/4018633574 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a9c07fc00 0x7f5a9c0a4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:22.453 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.446+0000 7f5aa41a9700 1 -- 172.21.15.139:0/4018633574 >> 172.21.15.139:0/4018633574 conn(0x7f5a9c05a720 msgr2=0x7f5a9c05ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:22.453 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.446+0000 7f5aa41a9700 1 -- 172.21.15.139:0/4018633574 shutdown_connections 2020-02-12T14:12:22.453 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.446+0000 7f5aa41a9700 1 -- 172.21.15.139:0/4018633574 wait complete. 2020-02-12T14:12:22.453 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.447+0000 7f5aa41a9700 1 Processor -- start 2020-02-12T14:12:22.453 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.447+0000 7f5aa41a9700 1 -- start start 2020-02-12T14:12:22.456 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.448+0000 7f5aa41a9700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f5a9c0a6d90 0x7f5a9c0640d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:22.456 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.448+0000 7f5aa41a9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9c0a9920 con 0x7f5a9c0a4140 2020-02-12T14:12:22.457 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.448+0000 7f5aa41a9700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9c0670b0 con 0x7f5a9c07fc00 2020-02-12T14:12:22.457 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.448+0000 7f5aa41a9700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a9c063990 con 0x7f5a9c0a6d90 2020-02-12T14:12:22.457 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.448+0000 7f5aa2746700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f5a9c07fc00 0x7f5a9c07e5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:34784/0 (socket says 172.21.15.139:34784) 2020-02-12T14:12:22.457 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.448+0000 7f5aa2746700 1 -- 172.21.15.139:0/4149831701 learned_addr learned my addr 172.21.15.139:0/4149831701 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:22.457 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.448+0000 7f5aa2f47700 1 --2- 172.21.15.139:0/4149831701 >> v2:172.21.15.139:3300/0 conn(0x7f5a9c0a6d90 0x7f5a9c0640d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:22.458 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.448+0000 7f5aa2f47700 1 -- 172.21.15.139:0/4149831701 >> v1:172.21.15.139:6789/0 conn(0x7f5a9c07fc00 legacy=0x7f5a9c07e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:22.458 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.448+0000 7f5aa2f47700 1 -- 172.21.15.139:0/4149831701 >> v1:172.21.15.72:6789/0 conn(0x7f5a9c0a4140 legacy=0x7f5a9c13a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:22.458 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.448+0000 7f5a92ffd700 1 -- 172.21.15.139:0/4149831701 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142738361 0 0) 0x7f5a9c0670b0 con 0x7f5a9c07fc00 2020-02-12T14:12:22.458 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.448+0000 7f5aa2f47700 1 -- 172.21.15.139:0/4149831701 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9c063c30 con 0x7f5a9c0a6d90 2020-02-12T14:12:22.458 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.448+0000 7f5aa2f47700 1 --2- 172.21.15.139:0/4149831701 >> v2:172.21.15.139:3300/0 conn(0x7f5a9c0a6d90 0x7f5a9c0640d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a9c0a7270 tx=0x7f5a9c0a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.458 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.448+0000 7f5aa2f47700 1 --2- 172.21.15.139:0/4149831701 >> v2:172.21.15.139:3300/0 conn(0x7f5a9c0a6d90 0x7f5a9c0640d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a9c0a7270 tx=0x7f5a9c0a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.459 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.448+0000 7f5aa2f47700 1 --2- 172.21.15.139:0/4149831701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a9c0a6d90 0x7f5a9c0640d0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f5a9c0a7270 tx=0x7f5a9c0a4520).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:22.459 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.448+0000 7f5aa2f47700 1 --2- 172.21.15.139:0/4149831701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a9c0a6d90 0x7f5a9c0640d0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f5a9c0a7270 tx=0x7f5a9c0a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.459 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.448+0000 7f5a92ffd700 1 -- 172.21.15.139:0/4149831701 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a94008a70 con 0x7f5a9c0a6d90 2020-02-12T14:12:22.459 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.448+0000 7f5aa2f47700 1 --2- 172.21.15.139:0/4149831701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a9c0a6d90 0x7f5a9c0640d0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f5a9c0a7270 tx=0x7f5a9c0a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.459 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.448+0000 7f5aa2f47700 1 --2- 172.21.15.139:0/4149831701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a9c0a6d90 0x7f5a9c0640d0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f5a9c0a7270 tx=0x7f5a9c0a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.459 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.448+0000 7f5a92ffd700 1 -- 172.21.15.139:0/4149831701 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a94005c30 con 0x7f5a9c0a6d90 2020-02-12T14:12:22.459 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.448+0000 7f5a92ffd700 1 -- 172.21.15.139:0/4149831701 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a94005e20 con 0x7f5a9c0a6d90 2020-02-12T14:12:22.460 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.448+0000 7f5aa41a9700 1 -- 172.21.15.139:0/4149831701 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a9c09d970 con 0x7f5a9c0a6d90 2020-02-12T14:12:22.460 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.448+0000 7f5aa41a9700 1 -- 172.21.15.139:0/4149831701 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a9c09dc20 con 0x7f5a9c0a6d90 2020-02-12T14:12:22.460 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.449+0000 7f5aa2f47700 1 --2- 172.21.15.139:0/4149831701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a9c0a6d90 0x7f5a9c0640d0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f5a9c0a7270 tx=0x7f5a9c0a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.460 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.449+0000 7f5a92ffd700 1 -- 172.21.15.139:0/4149831701 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 3) v1 ==== 45077+0+0 (secure 0 0 0) 0x7f5a9400f760 con 0x7f5a9c0a6d90 2020-02-12T14:12:22.460 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.449+0000 7f5aa2f47700 1 --2- 172.21.15.139:0/4149831701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a9c0a6d90 0x7f5a9c0640d0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f5a9c0a7270 tx=0x7f5a9c0a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.460 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.449+0000 7f5a92ffd700 1 --2- 172.21.15.139:0/4149831701 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f5a84039b40 0x7f5a8403c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:22.460 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.449+0000 7f5a92ffd700 1 -- 172.21.15.139:0/4149831701 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7f5a9404a7f0 con 0x7f5a9c0a6d90 2020-02-12T14:12:22.460 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.449+0000 7f5aa2746700 1 --2- 172.21.15.139:0/4149831701 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f5a84039b40 0x7f5a8403c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:22.460 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.449+0000 7f5aa41a9700 1 -- 172.21.15.139:0/4149831701 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a9c067e20 con 0x7f5a9c0a6d90 2020-02-12T14:12:22.461 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.450+0000 7f5aa2746700 1 --2- 172.21.15.139:0/4149831701 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f5a84039b40 0x7f5a8403c000 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:22.461 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.453+0000 7f5aa2f47700 1 --2- 172.21.15.139:0/4149831701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a9c0a6d90 0x7f5a9c0640d0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f5a9c0a7270 tx=0x7f5a9c0a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.461 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.453+0000 7f5a92ffd700 1 -- 172.21.15.139:0/4149831701 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f5a9402ff70 con 0x7f5a9c0a6d90 2020-02-12T14:12:22.604 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.603+0000 7f5aa41a9700 1 -- 172.21.15.139:0/4149831701 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f452adff-8432-47e9-a5f1-9fd7e2a04a92", "id": 7} v 0) v1 -- 0x7f5a9c063dc0 con 0x7f5a9c0a6d90 2020-02-12T14:12:22.608 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.607+0000 7f5aa2f47700 1 --2- 172.21.15.139:0/4149831701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a9c0a6d90 0x7f5a9c0640d0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f5a9c0a7270 tx=0x7f5a9c0a4520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:22.608 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.607+0000 7f5a92ffd700 1 -- 172.21.15.139:0/4149831701 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f452adff-8432-47e9-a5f1-9fd7e2a04a92", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5a94032a40 con 0x7f5a9c0a6d90 2020-02-12T14:12:22.608 INFO:teuthology.orchestra.run.smithi139.stdout:7 2020-02-12T14:12:22.610 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.608+0000 7f5aa41a9700 1 -- 172.21.15.139:0/4149831701 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f5a84039b40 msgr2=0x7f5a8403c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:22.610 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.608+0000 7f5aa41a9700 1 --2- 172.21.15.139:0/4149831701 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f5a84039b40 0x7f5a8403c000 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:22.611 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.608+0000 7f5aa41a9700 1 -- 172.21.15.139:0/4149831701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a9c0a6d90 msgr2=0x7f5a9c0640d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:22.611 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.608+0000 7f5aa41a9700 1 --2- 172.21.15.139:0/4149831701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a9c0a6d90 0x7f5a9c0640d0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f5a9c0a7270 tx=0x7f5a9c0a4520).stop 2020-02-12T14:12:22.611 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.608+0000 7f5aa41a9700 1 -- 172.21.15.139:0/4149831701 shutdown_connections 2020-02-12T14:12:22.611 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.608+0000 7f5aa41a9700 1 --2- 172.21.15.139:0/4149831701 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f5a84039b40 0x7f5a8403c000 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:22.611 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.608+0000 7f5aa41a9700 1 --2- 172.21.15.139:0/4149831701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a9c0a6d90 0x7f5a9c0640d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:22.611 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.608+0000 7f5aa41a9700 1 -- 172.21.15.139:0/4149831701 >> 172.21.15.139:0/4149831701 conn(0x7f5a9c05a720 msgr2=0x7f5a9c05e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:22.611 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.608+0000 7f5aa41a9700 1 -- 172.21.15.139:0/4149831701 shutdown_connections 2020-02-12T14:12:22.611 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:22.608+0000 7f5aa41a9700 1 -- 172.21.15.139:0/4149831701 wait complete. 2020-02-12T14:12:22.619 INFO:tasks.ceph.osd.4:Restarting daemon 2020-02-12T14:12:22.620 INFO:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-02-12T14:12:22.623 INFO:tasks.ceph.osd.4:Started 2020-02-12T14:12:22.623 INFO:tasks.ceph.osd.5:Restarting daemon 2020-02-12T14:12:22.623 INFO:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-02-12T14:12:22.625 INFO:tasks.ceph.osd.5:Started 2020-02-12T14:12:22.625 INFO:tasks.ceph.osd.6:Restarting daemon 2020-02-12T14:12:22.626 INFO:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-02-12T14:12:22.628 INFO:tasks.ceph.osd.6:Started 2020-02-12T14:12:22.628 INFO:tasks.ceph.osd.7:Restarting daemon 2020-02-12T14:12:22.628 INFO:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-02-12T14:12:22.630 INFO:tasks.ceph.osd.7:Started 2020-02-12T14:12:22.631 INFO:tasks.ceph.osd.0:Restarting daemon 2020-02-12T14:12:22.631 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-02-12T14:12:22.633 INFO:tasks.ceph.osd.0:Started 2020-02-12T14:12:22.633 INFO:tasks.ceph.osd.1:Restarting daemon 2020-02-12T14:12:22.634 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-02-12T14:12:22.635 INFO:tasks.ceph.osd.1:Started 2020-02-12T14:12:22.636 INFO:tasks.ceph.osd.2:Restarting daemon 2020-02-12T14:12:22.636 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-02-12T14:12:22.638 INFO:tasks.ceph.osd.2:Started 2020-02-12T14:12:22.638 INFO:tasks.ceph.osd.3:Restarting daemon 2020-02-12T14:12:22.638 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-02-12T14:12:22.640 INFO:tasks.ceph.osd.3:Started 2020-02-12T14:12:22.640 INFO:tasks.ceph:Waiting for OSDs to come up 2020-02-12T14:12:23.228 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T14:12:23.227+0000 7f96bebebec0 -1 Falling back to public interface 2020-02-12T14:12:23.231 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T14:12:23.231+0000 7f8c4dbbdec0 -1 Falling back to public interface 2020-02-12T14:12:23.232 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T14:12:23.231+0000 7f46fa5c6ec0 -1 Falling back to public interface 2020-02-12T14:12:23.233 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T14:12:23.232+0000 7fdd1b259ec0 -1 Falling back to public interface 2020-02-12T14:12:23.236 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T14:12:23.234+0000 7f0fd2285ec0 -1 Falling back to public interface 2020-02-12T14:12:23.236 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T14:12:23.235+0000 7fd1add57ec0 -1 Falling back to public interface 2020-02-12T14:12:23.238 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T14:12:23.237+0000 7f201003aec0 -1 Falling back to public interface 2020-02-12T14:12:23.240 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T14:12:23.239+0000 7f126061eec0 -1 Falling back to public interface 2020-02-12T14:12:23.448 INFO:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-02-12T14:12:23.564 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.559+0000 7f56c7265700 1 Processor -- start 2020-02-12T14:12:23.564 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.560+0000 7f56c7265700 1 -- start start 2020-02-12T14:12:23.564 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.560+0000 7f56c7265700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56c00aab00 0x7f56c00a1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:23.564 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.560+0000 7f56c7265700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f56c007fb80 0x7f56c00a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:23.564 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.560+0000 7f56c7265700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f56c005a750 0x7f56c005aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:23.565 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.560+0000 7f56c7265700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56c009a950 con 0x7f56c007fb80 2020-02-12T14:12:23.565 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.560+0000 7f56c7265700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56c00a2d40 con 0x7f56c005a750 2020-02-12T14:12:23.565 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.560+0000 7f56c7265700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c009ddf0 con 0x7f56c00aab00 2020-02-12T14:12:23.565 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.560+0000 7f56c5802700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56c00aab00 0x7f56c00a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:23.565 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.560+0000 7f56c6003700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f56c005a750 0x7f56c005aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:23.565 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.561+0000 7f56c6003700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f56c005a750 0x7f56c005aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46178/0 (socket says 172.21.15.139:46178) 2020-02-12T14:12:23.566 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.561+0000 7f56c5802700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56c00aab00 0x7f56c00a1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.139:38762/0 (socket says 172.21.15.139:38762) 2020-02-12T14:12:23.566 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.561+0000 7f56c6003700 1 -- 172.21.15.139:0/1117035398 learned_addr learned my addr 172.21.15.139:0/1117035398 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:23.566 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.561+0000 7f56c5001700 1 --2- 172.21.15.139:0/1117035398 >> v2:172.21.15.72:3300/0 conn(0x7f56c007fb80 0x7f56c00a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:23.566 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.561+0000 7f56c6003700 1 -- 172.21.15.139:0/1117035398 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56c00aab00 msgr2=0x7f56c00a1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:23.566 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.561+0000 7f56c6003700 1 --2- 172.21.15.139:0/1117035398 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56c00aab00 0x7f56c00a1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:23.566 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.561+0000 7f56c6003700 1 -- 172.21.15.139:0/1117035398 >> v2:172.21.15.72:3300/0 conn(0x7f56c007fb80 msgr2=0x7f56c00a1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:23.566 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.561+0000 7f56c6003700 1 --2- 172.21.15.139:0/1117035398 >> v2:172.21.15.72:3300/0 conn(0x7f56c007fb80 0x7f56c00a1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:23.566 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.561+0000 7f56c6003700 1 -- 172.21.15.139:0/1117035398 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c00a5870 con 0x7f56c005a750 2020-02-12T14:12:23.567 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.561+0000 7f56c6003700 1 --2- 172.21.15.139:0/1117035398 >> v2:172.21.15.139:3300/0 conn(0x7f56c005a750 0x7f56c005aba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f56b80032b0 tx=0x7f56b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:23.567 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.561+0000 7f56c6003700 1 --2- 172.21.15.139:0/1117035398 >> v2:172.21.15.139:3300/0 conn(0x7f56c005a750 0x7f56c005aba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f56b80032b0 tx=0x7f56b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:23.567 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.561+0000 7f56c6003700 1 --2- 172.21.15.139:0/1117035398 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56c005a750 0x7f56c005aba0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f56b80032b0 tx=0x7f56b8007dc0).ready entity=mon.1 client_cookie=116154c65484685c server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:23.567 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.561+0000 7f56c6003700 1 --2- 172.21.15.139:0/1117035398 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56c005a750 0x7f56c005aba0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f56b80032b0 tx=0x7f56b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:23.567 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.561+0000 7f56c6003700 1 --2- 172.21.15.139:0/1117035398 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56c005a750 0x7f56c005aba0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f56b80032b0 tx=0x7f56b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:23.567 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.561+0000 7f56c4800700 1 -- 172.21.15.139:0/1117035398 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56b8011c20 con 0x7f56c005a750 2020-02-12T14:12:23.567 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.561+0000 7f56c6003700 1 --2- 172.21.15.139:0/1117035398 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56c005a750 0x7f56c005aba0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f56b80032b0 tx=0x7f56b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:23.568 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.561+0000 7f56c4800700 1 -- 172.21.15.139:0/1117035398 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b8011d80 con 0x7f56c005a750 2020-02-12T14:12:23.568 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.561+0000 7f56c4800700 1 -- 172.21.15.139:0/1117035398 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56b800f430 con 0x7f56c005a750 2020-02-12T14:12:23.568 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.561+0000 7f56c7265700 1 -- 172.21.15.139:0/1117035398 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56c005a750 msgr2=0x7f56c005aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:23.568 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.561+0000 7f56c7265700 1 --2- 172.21.15.139:0/1117035398 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56c005a750 0x7f56c005aba0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f56b80032b0 tx=0x7f56b8007dc0).stop 2020-02-12T14:12:23.568 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.562+0000 7f56c7265700 1 -- 172.21.15.139:0/1117035398 shutdown_connections 2020-02-12T14:12:23.568 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.562+0000 7f56c7265700 1 --2- 172.21.15.139:0/1117035398 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56c005a750 0x7f56c005aba0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:23.568 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.562+0000 7f56c7265700 1 --2- 172.21.15.139:0/1117035398 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56c00aab00 0x7f56c00a1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:23.568 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.562+0000 7f56c7265700 1 --2- 172.21.15.139:0/1117035398 >> v2:172.21.15.72:3300/0 conn(0x7f56c007fb80 0x7f56c00a1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:23.569 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.562+0000 7f56c7265700 1 -- 172.21.15.139:0/1117035398 >> 172.21.15.139:0/1117035398 conn(0x7f56c005bfd0 msgr2=0x7f56c00aa230 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:23.569 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.562+0000 7f56c7265700 1 -- 172.21.15.139:0/1117035398 shutdown_connections 2020-02-12T14:12:23.569 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.562+0000 7f56c7265700 1 -- 172.21.15.139:0/1117035398 wait complete. 2020-02-12T14:12:23.572 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.564+0000 7f56c7265700 1 Processor -- start 2020-02-12T14:12:23.572 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.564+0000 7f56c7265700 1 -- start start 2020-02-12T14:12:23.572 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.565+0000 7f56c7265700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f56c005a750 0x7f56c007c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:23.572 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.565+0000 7f56c7265700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f56c00aab00 0x7f56c007cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:23.572 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.565+0000 7f56c7265700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56c01231b0 con 0x7f56c007fb80 2020-02-12T14:12:23.572 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.565+0000 7f56c5001700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f56c007fb80 0x7f56c0121700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:34820/0 (socket says 172.21.15.139:34820) 2020-02-12T14:12:23.573 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.565+0000 7f56c5802700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f56c005a750 0x7f56c007c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:23.573 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.565+0000 7f56c5001700 1 -- 172.21.15.139:0/1183898498 learned_addr learned my addr 172.21.15.139:0/1183898498 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:23.573 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.565+0000 7f56c7265700 1 -- 172.21.15.139:0/1183898498 --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56c00a1c50 con 0x7f56c00aab00 2020-02-12T14:12:23.573 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.565+0000 7f56c7265700 1 -- 172.21.15.139:0/1183898498 --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56c01235e0 con 0x7f56c005a750 2020-02-12T14:12:23.573 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.565+0000 7f56c6003700 1 --2- 172.21.15.139:0/1183898498 >> v2:172.21.15.72:3300/0 conn(0x7f56c00aab00 0x7f56c007cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:23.573 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.565+0000 7f56b67fc700 1 -- 172.21.15.139:0/1183898498 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556558298 0 0) 0x7f56c01231b0 con 0x7f56c007fb80 2020-02-12T14:12:23.573 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.565+0000 7f56b67fc700 1 -- 172.21.15.139:0/1183898498 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56a8007640 con 0x7f56c007fb80 2020-02-12T14:12:23.574 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.565+0000 7f56c5802700 1 -- 172.21.15.139:0/1183898498 >> v2:172.21.15.72:3300/0 conn(0x7f56c00aab00 msgr2=0x7f56c007cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:23.574 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.565+0000 7f56c5802700 1 --2- 172.21.15.139:0/1183898498 >> v2:172.21.15.72:3300/0 conn(0x7f56c00aab00 0x7f56c007cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:23.574 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.565+0000 7f56c5802700 1 -- 172.21.15.139:0/1183898498 >> v1:172.21.15.139:6789/0 conn(0x7f56c007fb80 legacy=0x7f56c0121700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:23.574 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.565+0000 7f56c5802700 1 -- 172.21.15.139:0/1183898498 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c0123880 con 0x7f56c005a750 2020-02-12T14:12:23.574 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.565+0000 7f56c5802700 1 --2- 172.21.15.139:0/1183898498 >> v2:172.21.15.139:3300/0 conn(0x7f56c005a750 0x7f56c007c7a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f56bc002f30 tx=0x7f56bc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:23.574 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.565+0000 7f56c5802700 1 --2- 172.21.15.139:0/1183898498 >> v2:172.21.15.139:3300/0 conn(0x7f56c005a750 0x7f56c007c7a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f56bc002f30 tx=0x7f56bc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:23.574 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.565+0000 7f56c5802700 1 --2- 172.21.15.139:0/1183898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56c005a750 0x7f56c007c7a0 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7f56bc002f30 tx=0x7f56bc010b40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:23.574 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.566+0000 7f56c5802700 1 --2- 172.21.15.139:0/1183898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56c005a750 0x7f56c007c7a0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f56bc002f30 tx=0x7f56bc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:23.575 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.566+0000 7f56b67fc700 1 -- 172.21.15.139:0/1183898498 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56bc012890 con 0x7f56c005a750 2020-02-12T14:12:23.575 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.566+0000 7f56c5802700 1 --2- 172.21.15.139:0/1183898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56c005a750 0x7f56c007c7a0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f56bc002f30 tx=0x7f56bc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:23.575 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.566+0000 7f56c5802700 1 --2- 172.21.15.139:0/1183898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56c005a750 0x7f56c007c7a0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f56bc002f30 tx=0x7f56bc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:23.575 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.566+0000 7f56b67fc700 1 -- 172.21.15.139:0/1183898498 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56bc0129f0 con 0x7f56c005a750 2020-02-12T14:12:23.575 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.566+0000 7f56b67fc700 1 -- 172.21.15.139:0/1183898498 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56bc012dd0 con 0x7f56c005a750 2020-02-12T14:12:23.575 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.566+0000 7f56c7265700 1 -- 172.21.15.139:0/1183898498 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c0123b20 con 0x7f56c005a750 2020-02-12T14:12:23.575 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.566+0000 7f56c7265700 1 -- 172.21.15.139:0/1183898498 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c007f440 con 0x7f56c005a750 2020-02-12T14:12:23.576 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.566+0000 7f56c5802700 1 --2- 172.21.15.139:0/1183898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56c005a750 0x7f56c007c7a0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f56bc002f30 tx=0x7f56bc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:23.576 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.567+0000 7f56b67fc700 1 -- 172.21.15.139:0/1183898498 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 3) v1 ==== 45077+0+0 (secure 0 0 0) 0x7f56bc007170 con 0x7f56c005a750 2020-02-12T14:12:23.576 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.567+0000 7f56c5802700 1 --2- 172.21.15.139:0/1183898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56c005a750 0x7f56c007c7a0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f56bc002f30 tx=0x7f56bc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:23.576 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.567+0000 7f56b67fc700 1 --2- 172.21.15.139:0/1183898498 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f56a803e280 0x7f56a8040740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:23.576 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.567+0000 7f56b67fc700 1 -- 172.21.15.139:0/1183898498 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f56bc0498d0 con 0x7f56c005a750 2020-02-12T14:12:23.576 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.567+0000 7f56c5001700 1 --2- 172.21.15.139:0/1183898498 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f56a803e280 0x7f56a8040740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:23.576 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.567+0000 7f56c7265700 1 -- 172.21.15.139:0/1183898498 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c0120fc0 con 0x7f56c005a750 2020-02-12T14:12:23.577 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.567+0000 7f56c5001700 1 --2- 172.21.15.139:0/1183898498 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f56a803e280 0x7f56a8040740 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:23.577 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.574+0000 7f56c5802700 1 --2- 172.21.15.139:0/1183898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56c005a750 0x7f56c007c7a0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f56bc002f30 tx=0x7f56bc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:23.577 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.574+0000 7f56b67fc700 1 -- 172.21.15.139:0/1183898498 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f56bc02eeb0 con 0x7f56c005a750 2020-02-12T14:12:23.749 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.748+0000 7f56c7265700 1 -- 172.21.15.139:0/1183898498 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56c0067e20 con 0x7f56c005a750 2020-02-12T14:12:23.750 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.749+0000 7f56c5802700 1 --2- 172.21.15.139:0/1183898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56c005a750 0x7f56c007c7a0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f56bc002f30 tx=0x7f56bc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:23.750 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.749+0000 7f56b67fc700 1 -- 172.21.15.139:0/1183898498 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+6849 (secure 0 0 0) 0x7f56bc031980 con 0x7f56c005a750 2020-02-12T14:12:23.751 INFO:teuthology.misc.health.smithi139.stdout: 2020-02-12T14:12:23.751 INFO:teuthology.misc.health.smithi139.stdout:{"epoch":10,"fsid":"dacc9a6c-9e88-46ac-940b-c4a329dbffec","created":"2020-02-12T14:12:18.258232+0000","modified":"2020-02-12T14:12:22.604448+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"ffc0664d-9b93-45a4-a454-7655ee26d582","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f66da6bc-43b3-4846-85f9-a25e3fe95216","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c35fb293-3e16-41e8-85f3-768e11e55b83","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bc8b2c0d-e3dd-48cb-883e-6ea965aee923","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"aadfc406-0c40-4b6b-9e19-c92b2f40264a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3296dc8e-9322-4430-abd2-7672da5b7acc","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7c39cf20-a3a8-4d56-8577-f4102b302a11","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f452adff-8432-47e9-a5f1-9fd7e2a04a92","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-12T14:12:23.752 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.750+0000 7f56c7265700 1 -- 172.21.15.139:0/1183898498 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f56a803e280 msgr2=0x7f56a8040740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:23.752 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.750+0000 7f56c7265700 1 --2- 172.21.15.139:0/1183898498 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f56a803e280 0x7f56a8040740 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:23.752 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.750+0000 7f56c7265700 1 -- 172.21.15.139:0/1183898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56c005a750 msgr2=0x7f56c007c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:23.752 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.750+0000 7f56c7265700 1 --2- 172.21.15.139:0/1183898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56c005a750 0x7f56c007c7a0 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7f56bc002f30 tx=0x7f56bc010b40).stop 2020-02-12T14:12:23.753 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.750+0000 7f56c7265700 1 -- 172.21.15.139:0/1183898498 shutdown_connections 2020-02-12T14:12:23.753 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.750+0000 7f56c7265700 1 --2- 172.21.15.139:0/1183898498 >> v2:172.21.15.72:3300/0 conn(0x7f56c00aab00 0x7f56c007cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:23.753 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.750+0000 7f56c7265700 1 --2- 172.21.15.139:0/1183898498 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f56a803e280 0x7f56a8040740 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:23.753 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.750+0000 7f56c7265700 1 --2- 172.21.15.139:0/1183898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56c005a750 0x7f56c007c7a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:23.753 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.750+0000 7f56c7265700 1 -- 172.21.15.139:0/1183898498 >> 172.21.15.139:0/1183898498 conn(0x7f56c005bfd0 msgr2=0x7f56c005e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:23.753 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.750+0000 7f56c7265700 1 -- 172.21.15.139:0/1183898498 shutdown_connections 2020-02-12T14:12:23.753 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:23.750+0000 7f56c7265700 1 -- 172.21.15.139:0/1183898498 wait complete. 2020-02-12T14:12:23.761 DEBUG:teuthology.misc:0 of 8 OSDs are up 2020-02-12T14:12:24.056 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T14:12:24.055+0000 7fd1add57ec0 -1 osd.6 0 log_to_monitors {default=true} 2020-02-12T14:12:24.291 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T14:12:24.290+0000 7f96bebebec0 -1 osd.0 0 log_to_monitors {default=true} 2020-02-12T14:12:24.295 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T14:12:24.294+0000 7f8c4dbbdec0 -1 osd.4 0 log_to_monitors {default=true} 2020-02-12T14:12:24.304 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T14:12:24.303+0000 7f201003aec0 -1 osd.2 0 log_to_monitors {default=true} 2020-02-12T14:12:24.307 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T14:12:24.306+0000 7fdd1b259ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-02-12T14:12:24.316 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T14:12:24.315+0000 7f46fa5c6ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-02-12T14:12:24.316 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T14:12:24.315+0000 7f0fd2285ec0 -1 osd.5 0 log_to_monitors {default=true} 2020-02-12T14:12:24.316 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T14:12:24.315+0000 7f126061eec0 -1 osd.7 0 log_to_monitors {default=true} 2020-02-12T14:12:26.052 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T14:12:26.051+0000 7fd196522700 -1 osd.6 0 waiting for initial osdmap 2020-02-12T14:12:26.053 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T14:12:26.053+0000 7f1248de9700 -1 osd.7 0 waiting for initial osdmap 2020-02-12T14:12:26.054 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T14:12:26.053+0000 7f0fbaa50700 -1 osd.5 0 waiting for initial osdmap 2020-02-12T14:12:26.054 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T14:12:26.053+0000 7fdd03a24700 -1 osd.3 0 waiting for initial osdmap 2020-02-12T14:12:26.055 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T14:12:26.054+0000 7f96a73b6700 -1 osd.0 0 waiting for initial osdmap 2020-02-12T14:12:26.056 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T14:12:26.055+0000 7f1ff8805700 -1 osd.2 0 waiting for initial osdmap 2020-02-12T14:12:26.058 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T14:12:26.057+0000 7f46e2d91700 -1 osd.1 0 waiting for initial osdmap 2020-02-12T14:12:26.058 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T14:12:26.057+0000 7f8c36388700 -1 osd.4 0 waiting for initial osdmap 2020-02-12T14:12:30.567 INFO:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-02-12T14:12:30.675 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.671+0000 7fbc06b48700 1 Processor -- start 2020-02-12T14:12:30.676 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.672+0000 7fbc06b48700 1 -- start start 2020-02-12T14:12:30.676 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.672+0000 7fbc06b48700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbc000aab00 0x7fbc000a1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:30.676 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.672+0000 7fbc06b48700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc000a1ae0 0x7fbc0005ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:30.676 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.672+0000 7fbc06b48700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc0009a950 con 0x7fbc0007fb80 2020-02-12T14:12:30.676 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.672+0000 7fbc06b48700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc000a2d40 con 0x7fbc000aab00 2020-02-12T14:12:30.676 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.672+0000 7fbc06b48700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0009ddf0 con 0x7fbc000a1ae0 2020-02-12T14:12:30.677 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.672+0000 7fbc050e5700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbc000aab00 0x7fbc000a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:30.677 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.672+0000 7fbc048e4700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fbc0007fb80 0x7fbc0005a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35044/0 (socket says 172.21.15.139:35044) 2020-02-12T14:12:30.677 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.672+0000 7fbc048e4700 1 -- 172.21.15.139:0/2441587950 learned_addr learned my addr 172.21.15.139:0/2441587950 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:30.677 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.672+0000 7fbc058e6700 1 --2- 172.21.15.139:0/2441587950 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc000a1ae0 0x7fbc0005ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:30.677 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.673+0000 7fbc050e5700 1 -- 172.21.15.139:0/2441587950 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc000a1ae0 msgr2=0x7fbc0005ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:30.677 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.673+0000 7fbc050e5700 1 --2- 172.21.15.139:0/2441587950 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc000a1ae0 0x7fbc0005ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:30.678 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.673+0000 7fbc050e5700 1 -- 172.21.15.139:0/2441587950 >> v1:172.21.15.139:6789/0 conn(0x7fbc0007fb80 legacy=0x7fbc0005a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:30.678 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.673+0000 7fbbf3fff700 1 -- 172.21.15.139:0/2441587950 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909212583 0 0) 0x7fbc0009a950 con 0x7fbc0007fb80 2020-02-12T14:12:30.678 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.673+0000 7fbc050e5700 1 -- 172.21.15.139:0/2441587950 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc000a5870 con 0x7fbc000aab00 2020-02-12T14:12:30.679 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.673+0000 7fbc050e5700 1 --2- 172.21.15.139:0/2441587950 >> v2:172.21.15.139:3300/0 conn(0x7fbc000aab00 0x7fbc000a1680 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbbf4002f30 tx=0x7fbbf40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.679 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.673+0000 7fbc050e5700 1 --2- 172.21.15.139:0/2441587950 >> v2:172.21.15.139:3300/0 conn(0x7fbc000aab00 0x7fbc000a1680 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbbf4002f30 tx=0x7fbbf40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.679 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.673+0000 7fbc050e5700 1 --2- 172.21.15.139:0/2441587950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc000aab00 0x7fbc000a1680 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7fbbf4002f30 tx=0x7fbbf40088e0).ready entity=mon.1 client_cookie=6473630a150a6e2c server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:30.680 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.673+0000 7fbc050e5700 1 --2- 172.21.15.139:0/2441587950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc000aab00 0x7fbc000a1680 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fbbf4002f30 tx=0x7fbbf40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.680 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.673+0000 7fbbf3fff700 1 -- 172.21.15.139:0/2441587950 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbf4008e40 con 0x7fbc000aab00 2020-02-12T14:12:30.680 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.673+0000 7fbc050e5700 1 --2- 172.21.15.139:0/2441587950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc000aab00 0x7fbc000a1680 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fbbf4002f30 tx=0x7fbbf40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.680 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.673+0000 7fbbf3fff700 1 -- 172.21.15.139:0/2441587950 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf40116a0 con 0x7fbc000aab00 2020-02-12T14:12:30.680 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.673+0000 7fbc050e5700 1 --2- 172.21.15.139:0/2441587950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc000aab00 0x7fbc000a1680 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fbbf4002f30 tx=0x7fbbf40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.680 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.673+0000 7fbbf3fff700 1 -- 172.21.15.139:0/2441587950 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbf4011a40 con 0x7fbc000aab00 2020-02-12T14:12:30.681 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.673+0000 7fbc06b48700 1 -- 172.21.15.139:0/2441587950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc000aab00 msgr2=0x7fbc000a1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:30.681 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.673+0000 7fbc06b48700 1 --2- 172.21.15.139:0/2441587950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc000aab00 0x7fbc000a1680 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7fbbf4002f30 tx=0x7fbbf40088e0).stop 2020-02-12T14:12:30.681 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.673+0000 7fbc06b48700 1 -- 172.21.15.139:0/2441587950 shutdown_connections 2020-02-12T14:12:30.681 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.673+0000 7fbc06b48700 1 --2- 172.21.15.139:0/2441587950 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc000a1ae0 0x7fbc0005ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:30.681 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.673+0000 7fbc06b48700 1 --2- 172.21.15.139:0/2441587950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc000aab00 0x7fbc000a1680 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:30.681 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.673+0000 7fbc06b48700 1 -- 172.21.15.139:0/2441587950 >> 172.21.15.139:0/2441587950 conn(0x7fbc0005bfd0 msgr2=0x7fbc000aa230 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:30.681 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.674+0000 7fbc06b48700 1 -- 172.21.15.139:0/2441587950 shutdown_connections 2020-02-12T14:12:30.682 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.674+0000 7fbc06b48700 1 -- 172.21.15.139:0/2441587950 wait complete. 2020-02-12T14:12:30.687 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.675+0000 7fbc06b48700 1 Processor -- start 2020-02-12T14:12:30.687 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.675+0000 7fbc06b48700 1 -- start start 2020-02-12T14:12:30.687 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.675+0000 7fbc06b48700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc000a1ae0 0x7fbc00065270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:30.687 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.675+0000 7fbc06b48700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc00061ec0 con 0x7fbc0007fb80 2020-02-12T14:12:30.687 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.675+0000 7fbc06b48700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc0007f440 con 0x7fbc000aab00 2020-02-12T14:12:30.688 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.675+0000 7fbc06b48700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc000620f0 con 0x7fbc000a1ae0 2020-02-12T14:12:30.688 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.675+0000 7fbc058e6700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fbc000aab00 0x7fbc0007dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35052/0 (socket says 172.21.15.139:35052) 2020-02-12T14:12:30.688 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.675+0000 7fbc058e6700 1 -- 172.21.15.139:0/764492804 learned_addr learned my addr 172.21.15.139:0/764492804 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:30.688 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbc048e4700 1 --2- 172.21.15.139:0/764492804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc000a1ae0 0x7fbc00065270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:30.688 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbbf1ffb700 1 -- 172.21.15.139:0/764492804 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594570606 0 0) 0x7fbc0007f440 con 0x7fbc000aab00 2020-02-12T14:12:30.688 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbbf1ffb700 1 -- 172.21.15.139:0/764492804 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbe0003230 con 0x7fbc000aab00 2020-02-12T14:12:30.688 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbbf1ffb700 1 -- 172.21.15.139:0/764492804 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260067199 0 0) 0x7fbc00061ec0 con 0x7fbc0007fb80 2020-02-12T14:12:30.689 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbbf1ffb700 1 -- 172.21.15.139:0/764492804 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc0007f440 con 0x7fbc0007fb80 2020-02-12T14:12:30.689 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbbf1ffb700 1 -- 172.21.15.139:0/764492804 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1186859035 0 0) 0x7fbbe0003230 con 0x7fbc000aab00 2020-02-12T14:12:30.689 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbbf1ffb700 1 -- 172.21.15.139:0/764492804 --> v1:172.21.15.139:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbc00061ec0 con 0x7fbc000aab00 2020-02-12T14:12:30.689 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbbf1ffb700 1 -- 172.21.15.139:0/764492804 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7fbbf80018e0 con 0x7fbc000aab00 2020-02-12T14:12:30.689 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbbf1ffb700 1 -- 172.21.15.139:0/764492804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc000a1ae0 msgr2=0x7fbc00065270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:30.689 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbbf1ffb700 1 --2- 172.21.15.139:0/764492804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc000a1ae0 0x7fbc00065270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:30.689 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbbf1ffb700 1 -- 172.21.15.139:0/764492804 >> v1:172.21.15.139:6789/0 conn(0x7fbc000aab00 legacy=0x7fbc0007dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:30.689 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbbf1ffb700 1 -- 172.21.15.139:0/764492804 >> v1:172.21.15.72:6789/0 conn(0x7fbc0007fb80 legacy=0x7fbc00062c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:30.690 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbbf1ffb700 1 --2- 172.21.15.139:0/764492804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbe0003960 0x7fbbe0003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:30.690 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbbf1ffb700 1 --2- 172.21.15.139:0/764492804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbbe00044d0 0x7fbbe0004930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:30.690 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbbf1ffb700 1 --2- 172.21.15.139:0/764492804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbe0004d90 0x7fbbe000b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:30.690 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbbf1ffb700 1 -- 172.21.15.139:0/764492804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc000620f0 con 0x7fbbe0004d90 2020-02-12T14:12:30.690 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbbf1ffb700 1 -- 172.21.15.139:0/764492804 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe0005300 con 0x7fbbe0003960 2020-02-12T14:12:30.690 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbbf1ffb700 1 -- 172.21.15.139:0/764492804 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe000bb80 con 0x7fbbe00044d0 2020-02-12T14:12:30.690 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbc048e4700 1 --2- 172.21.15.139:0/764492804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc000a1ae0 0x7fbc00065270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T14:12:30.691 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbc050e5700 1 --2- 172.21.15.139:0/764492804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbe0003960 0x7fbbe0003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:30.691 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbc058e6700 1 --2- 172.21.15.139:0/764492804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbe0004d90 0x7fbbe000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:30.691 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbc048e4700 1 --2- 172.21.15.139:0/764492804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbbe00044d0 0x7fbbe0004930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:30.691 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbc050e5700 1 -- 172.21.15.139:0/764492804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbbe00044d0 msgr2=0x7fbbe0004930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:30.691 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbc050e5700 1 --2- 172.21.15.139:0/764492804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbbe00044d0 0x7fbbe0004930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:30.691 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbc050e5700 1 -- 172.21.15.139:0/764492804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbe0004d90 msgr2=0x7fbbe000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:30.691 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbc050e5700 1 --2- 172.21.15.139:0/764492804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbe0004d90 0x7fbbe000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:30.692 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbc050e5700 1 -- 172.21.15.139:0/764492804 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc00062390 con 0x7fbbe0003960 2020-02-12T14:12:30.692 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbc06b48700 1 -- 172.21.15.139:0/764492804 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc00062630 con 0x7fbbe0003960 2020-02-12T14:12:30.692 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.676+0000 7fbc050e5700 1 --2- 172.21.15.139:0/764492804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbe0003960 0x7fbbe0003d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbbf4007ed0 tx=0x7fbc000a2030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.692 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.677+0000 7fbc06b48700 1 -- 172.21.15.139:0/764492804 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc00063360 con 0x7fbbe0003960 2020-02-12T14:12:30.692 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.677+0000 7fbc050e5700 1 --2- 172.21.15.139:0/764492804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbe0003960 0x7fbbe0003d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbbf4007ed0 tx=0x7fbc000a2030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.692 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.677+0000 7fbc050e5700 1 --2- 172.21.15.139:0/764492804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbe0003960 0x7fbbe0003d60 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7fbbf4007ed0 tx=0x7fbc000a2030).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:30.692 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.677+0000 7fbc050e5700 1 --2- 172.21.15.139:0/764492804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbe0003960 0x7fbbe0003d60 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fbbf4007ed0 tx=0x7fbc000a2030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.693 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.677+0000 7fbbf1ffb700 1 -- 172.21.15.139:0/764492804 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbf4007180 con 0x7fbbe0003960 2020-02-12T14:12:30.693 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.677+0000 7fbc050e5700 1 --2- 172.21.15.139:0/764492804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbe0003960 0x7fbbe0003d60 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fbbf4007ed0 tx=0x7fbc000a2030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.693 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.677+0000 7fbc050e5700 1 --2- 172.21.15.139:0/764492804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbe0003960 0x7fbbe0003d60 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fbbf4007ed0 tx=0x7fbc000a2030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.693 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.677+0000 7fbbf1ffb700 1 -- 172.21.15.139:0/764492804 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf40072e0 con 0x7fbbe0003960 2020-02-12T14:12:30.693 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.677+0000 7fbbf1ffb700 1 -- 172.21.15.139:0/764492804 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbf40056c0 con 0x7fbbe0003960 2020-02-12T14:12:30.693 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.677+0000 7fbc050e5700 1 --2- 172.21.15.139:0/764492804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbe0003960 0x7fbbe0003d60 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fbbf4007ed0 tx=0x7fbc000a2030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.693 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.677+0000 7fbbf1ffb700 1 -- 172.21.15.139:0/764492804 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fbbf4005820 con 0x7fbbe0003960 2020-02-12T14:12:30.694 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.677+0000 7fbc050e5700 1 --2- 172.21.15.139:0/764492804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbe0003960 0x7fbbe0003d60 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fbbf4007ed0 tx=0x7fbc000a2030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.694 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.677+0000 7fbc06b48700 1 -- 172.21.15.139:0/764492804 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd8003340 con 0x7fbbe0003960 2020-02-12T14:12:30.694 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.678+0000 7fbbf1ffb700 1 --2- 172.21.15.139:0/764492804 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fbbe0042690 0x7fbbe0044b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:30.694 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.678+0000 7fbbf1ffb700 1 -- 172.21.15.139:0/764492804 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4500+0+0 (secure 0 0 0) 0x7fbbf404c230 con 0x7fbbe0003960 2020-02-12T14:12:30.694 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.678+0000 7fbc048e4700 1 --2- 172.21.15.139:0/764492804 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fbbe0042690 0x7fbbe0044b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:30.694 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.678+0000 7fbc048e4700 1 --2- 172.21.15.139:0/764492804 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fbbe0042690 0x7fbbe0044b50 crc :-1 s=READY pgs=33 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:30.694 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.681+0000 7fbc050e5700 1 --2- 172.21.15.139:0/764492804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbe0003960 0x7fbbe0003d60 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fbbf4007ed0 tx=0x7fbc000a2030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.694 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.681+0000 7fbbf1ffb700 1 -- 172.21.15.139:0/764492804 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fbbf4031980 con 0x7fbbe0003960 2020-02-12T14:12:30.819 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.818+0000 7fbc06b48700 1 -- 172.21.15.139:0/764492804 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbd80021d0 con 0x7fbbe0003960 2020-02-12T14:12:30.820 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.818+0000 7fbc050e5700 1 --2- 172.21.15.139:0/764492804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbe0003960 0x7fbbe0003d60 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fbbf4007ed0 tx=0x7fbc000a2030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.820 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.818+0000 7fbbf1ffb700 1 -- 172.21.15.139:0/764492804 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10439 (secure 0 0 0) 0x7fbbf4034430 con 0x7fbbe0003960 2020-02-12T14:12:30.820 INFO:teuthology.misc.health.smithi139.stdout: 2020-02-12T14:12:30.820 INFO:teuthology.misc.health.smithi139.stdout:{"epoch":14,"fsid":"dacc9a6c-9e88-46ac-940b-c4a329dbffec","created":"2020-02-12T14:12:18.258232+0000","modified":"2020-02-12T14:12:28.061075+0000","last_up_change":"2020-02-12T14:12:27.050924+0000","last_in_change":"2020-02-12T14:12:27.050924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"ffc0664d-9b93-45a4-a454-7655ee26d582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":22147},{"type":"v1","addr":"172.21.15.139:6803","nonce":22147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":22147},{"type":"v1","addr":"172.21.15.139:6805","nonce":22147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":22147},{"type":"v1","addr":"172.21.15.139:6809","nonce":22147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":22147},{"type":"v1","addr":"172.21.15.139:6807","nonce":22147}]},"public_addr":"172.21.15.139:6803/22147","cluster_addr":"172.21.15.139:6805/22147","heartbeat_back_addr":"172.21.15.139:6809/22147","heartbeat_front_addr":"172.21.15.139:6807/22147","state":["exists","up"]},{"osd":1,"uuid":"f66da6bc-43b3-4846-85f9-a25e3fe95216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":22148},{"type":"v1","addr":"172.21.15.139:6811","nonce":22148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":22148},{"type":"v1","addr":"172.21.15.139:6813","nonce":22148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6819","nonce":22148},{"type":"v1","addr":"172.21.15.139:6821","nonce":22148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6815","nonce":22148},{"type":"v1","addr":"172.21.15.139:6817","nonce":22148}]},"public_addr":"172.21.15.139:6811/22148","cluster_addr":"172.21.15.139:6813/22148","heartbeat_back_addr":"172.21.15.139:6821/22148","heartbeat_front_addr":"172.21.15.139:6817/22148","state":["exists","up"]},{"osd":2,"uuid":"c35fb293-3e16-41e8-85f3-768e11e55b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":22149},{"type":"v1","addr":"172.21.15.139:6827","nonce":22149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":22149},{"type":"v1","addr":"172.21.15.139:6829","nonce":22149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":22149},{"type":"v1","addr":"172.21.15.139:6833","nonce":22149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":22149},{"type":"v1","addr":"172.21.15.139:6831","nonce":22149}]},"public_addr":"172.21.15.139:6827/22149","cluster_addr":"172.21.15.139:6829/22149","heartbeat_back_addr":"172.21.15.139:6833/22149","heartbeat_front_addr":"172.21.15.139:6831/22149","state":["exists","up"]},{"osd":3,"uuid":"bc8b2c0d-e3dd-48cb-883e-6ea965aee923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":22150},{"type":"v1","addr":"172.21.15.139:6816","nonce":22150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":22150},{"type":"v1","addr":"172.21.15.139:6820","nonce":22150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":22150},{"type":"v1","addr":"172.21.15.139:6825","nonce":22150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":22150},{"type":"v1","addr":"172.21.15.139:6823","nonce":22150}]},"public_addr":"172.21.15.139:6816/22150","cluster_addr":"172.21.15.139:6820/22150","heartbeat_back_addr":"172.21.15.139:6825/22150","heartbeat_front_addr":"172.21.15.139:6823/22150","state":["exists","up"]},{"osd":4,"uuid":"aadfc406-0c40-4b6b-9e19-c92b2f40264a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":21598},{"type":"v1","addr":"172.21.15.72:6801","nonce":21598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":21598},{"type":"v1","addr":"172.21.15.72:6803","nonce":21598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":21598},{"type":"v1","addr":"172.21.15.72:6807","nonce":21598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":21598},{"type":"v1","addr":"172.21.15.72:6805","nonce":21598}]},"public_addr":"172.21.15.72:6801/21598","cluster_addr":"172.21.15.72:6803/21598","heartbeat_back_addr":"172.21.15.72:6807/21598","heartbeat_front_addr":"172.21.15.72:6805/21598","state":["exists","up"]},{"osd":5,"uuid":"3296dc8e-9322-4430-abd2-7672da5b7acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":21599},{"type":"v1","addr":"172.21.15.72:6810","nonce":21599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":21599},{"type":"v1","addr":"172.21.15.72:6815","nonce":21599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":21599},{"type":"v1","addr":"172.21.15.72:6823","nonce":21599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":21599},{"type":"v1","addr":"172.21.15.72:6820","nonce":21599}]},"public_addr":"172.21.15.72:6810/21599","cluster_addr":"172.21.15.72:6815/21599","heartbeat_back_addr":"172.21.15.72:6823/21599","heartbeat_front_addr":"172.21.15.72:6820/21599","state":["exists","up"]},{"osd":6,"uuid":"7c39cf20-a3a8-4d56-8577-f4102b302a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":21601},{"type":"v1","addr":"172.21.15.72:6811","nonce":21601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":21601},{"type":"v1","addr":"172.21.15.72:6814","nonce":21601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":21601},{"type":"v1","addr":"172.21.15.72:6821","nonce":21601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":21601},{"type":"v1","addr":"172.21.15.72:6818","nonce":21601}]},"public_addr":"172.21.15.72:6811/21601","cluster_addr":"172.21.15.72:6814/21601","heartbeat_back_addr":"172.21.15.72:6821/21601","heartbeat_front_addr":"172.21.15.72:6818/21601","state":["exists","up"]},{"osd":7,"uuid":"f452adff-8432-47e9-a5f1-9fd7e2a04a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":21600},{"type":"v1","addr":"172.21.15.72:6825","nonce":21600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":21600},{"type":"v1","addr":"172.21.15.72:6827","nonce":21600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":21600},{"type":"v1","addr":"172.21.15.72:6831","nonce":21600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":21600},{"type":"v1","addr":"172.21.15.72:6829","nonce":21600}]},"public_addr":"172.21.15.72:6825/21600","cluster_addr":"172.21.15.72:6827/21600","heartbeat_back_addr":"172.21.15.72:6831/21600","heartbeat_front_addr":"172.21.15.72:6829/21600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.259782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.267019+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.315501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.326256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.335328+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.284130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.083179+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.351445+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-12T14:12:30.821 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.820+0000 7fbc06b48700 1 -- 172.21.15.139:0/764492804 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fbbe0042690 msgr2=0x7fbbe0044b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:30.822 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.820+0000 7fbc06b48700 1 --2- 172.21.15.139:0/764492804 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fbbe0042690 0x7fbbe0044b50 crc :-1 s=READY pgs=33 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:30.822 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.820+0000 7fbc06b48700 1 -- 172.21.15.139:0/764492804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbe0003960 msgr2=0x7fbbe0003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:30.822 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.820+0000 7fbc06b48700 1 --2- 172.21.15.139:0/764492804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbe0003960 0x7fbbe0003d60 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7fbbf4007ed0 tx=0x7fbc000a2030).stop 2020-02-12T14:12:30.822 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.820+0000 7fbc058e6700 1 -- 172.21.15.139:0/764492804 reap_dead start 2020-02-12T14:12:30.822 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.820+0000 7fbc058e6700 1 -- 172.21.15.139:0/764492804 reap_dead start 2020-02-12T14:12:30.822 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.820+0000 7fbc06b48700 1 -- 172.21.15.139:0/764492804 shutdown_connections 2020-02-12T14:12:30.822 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.820+0000 7fbc06b48700 1 -- 172.21.15.139:0/764492804 >> 172.21.15.139:0/764492804 conn(0x7fbc0005bfd0 msgr2=0x7fbc0005e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:30.823 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.820+0000 7fbc06b48700 1 -- 172.21.15.139:0/764492804 shutdown_connections 2020-02-12T14:12:30.823 INFO:teuthology.misc.health.smithi139.stderr:2020-02-12T14:12:30.820+0000 7fbc06b48700 1 -- 172.21.15.139:0/764492804 wait complete. 2020-02-12T14:12:30.830 DEBUG:teuthology.misc:8 of 8 OSDs are up 2020-02-12T14:12:30.831 INFO:tasks.ceph:Creating RBD pool 2020-02-12T14:12:30.832 INFO:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd pool create rbd 8 2020-02-12T14:12:30.939 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.935+0000 7f36de895700 1 Processor -- start 2020-02-12T14:12:30.939 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.935+0000 7f36de895700 1 -- start start 2020-02-12T14:12:30.939 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.935+0000 7f36de895700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f36d80a4140 0x7f36d80a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:30.939 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.935+0000 7f36de895700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d80a6d90 0x7f36d814e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:30.939 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.935+0000 7f36de895700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d809a700 con 0x7f36d807fc00 2020-02-12T14:12:30.939 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.935+0000 7f36de895700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d80a5520 con 0x7f36d80a4140 2020-02-12T14:12:30.940 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.935+0000 7f36de895700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d80a57c0 con 0x7f36d80a6d90 2020-02-12T14:12:30.940 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.935+0000 7f36dce32700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f36d80a4140 0x7f36d80a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:30.940 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.935+0000 7f36d7fff700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f36d807fc00 0x7f36d80a6680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35062/0 (socket says 172.21.15.139:35062) 2020-02-12T14:12:30.940 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.936+0000 7f36d7fff700 1 -- 172.21.15.139:0/1085804621 learned_addr learned my addr 172.21.15.139:0/1085804621 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:30.940 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.936+0000 7f36dd633700 1 --2- 172.21.15.139:0/1085804621 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d80a6d90 0x7f36d814e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:30.940 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.936+0000 7f36dce32700 1 -- 172.21.15.139:0/1085804621 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d80a6d90 msgr2=0x7f36d814e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:30.940 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.936+0000 7f36dce32700 1 --2- 172.21.15.139:0/1085804621 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d80a6d90 0x7f36d814e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:30.941 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.936+0000 7f36dce32700 1 -- 172.21.15.139:0/1085804621 >> v1:172.21.15.139:6789/0 conn(0x7f36d807fc00 legacy=0x7f36d80a6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:30.941 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.936+0000 7f36dce32700 1 -- 172.21.15.139:0/1085804621 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d814fe00 con 0x7f36d80a4140 2020-02-12T14:12:30.941 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.936+0000 7f36d77fe700 1 -- 172.21.15.139:0/1085804621 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3849199774 0 0) 0x7f36d809a700 con 0x7f36d807fc00 2020-02-12T14:12:30.941 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.936+0000 7f36dd633700 1 --2- 172.21.15.139:0/1085804621 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d80a6d90 0x7f36d814e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T14:12:30.941 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.936+0000 7f36dce32700 1 --2- 172.21.15.139:0/1085804621 >> v2:172.21.15.139:3300/0 conn(0x7f36d80a4140 0x7f36d80a4fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f36c8002f30 tx=0x7f36c80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.941 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.936+0000 7f36dce32700 1 --2- 172.21.15.139:0/1085804621 >> v2:172.21.15.139:3300/0 conn(0x7f36d80a4140 0x7f36d80a4fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f36c8002f30 tx=0x7f36c80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.941 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.936+0000 7f36dce32700 1 --2- 172.21.15.139:0/1085804621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36d80a4140 0x7f36d80a4fd0 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f36c8002f30 tx=0x7f36c80088e0).ready entity=mon.1 client_cookie=b8f0d64cb34a2427 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:30.942 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.936+0000 7f36dce32700 1 --2- 172.21.15.139:0/1085804621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36d80a4140 0x7f36d80a4fd0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f36c8002f30 tx=0x7f36c80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.942 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.936+0000 7f36d77fe700 1 -- 172.21.15.139:0/1085804621 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36c8008e40 con 0x7f36d80a4140 2020-02-12T14:12:30.942 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.936+0000 7f36dce32700 1 --2- 172.21.15.139:0/1085804621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36d80a4140 0x7f36d80a4fd0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f36c8002f30 tx=0x7f36c80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.942 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.936+0000 7f36dce32700 1 --2- 172.21.15.139:0/1085804621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36d80a4140 0x7f36d80a4fd0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f36c8002f30 tx=0x7f36c80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.942 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.936+0000 7f36d77fe700 1 -- 172.21.15.139:0/1085804621 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c80116a0 con 0x7f36d80a4140 2020-02-12T14:12:30.942 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.936+0000 7f36d77fe700 1 -- 172.21.15.139:0/1085804621 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36c8011a40 con 0x7f36d80a4140 2020-02-12T14:12:30.942 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.936+0000 7f36de895700 1 -- 172.21.15.139:0/1085804621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36d80a4140 msgr2=0x7f36d80a4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:30.943 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.936+0000 7f36de895700 1 --2- 172.21.15.139:0/1085804621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36d80a4140 0x7f36d80a4fd0 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f36c8002f30 tx=0x7f36c80088e0).stop 2020-02-12T14:12:30.943 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.936+0000 7f36de895700 1 -- 172.21.15.139:0/1085804621 shutdown_connections 2020-02-12T14:12:30.943 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.936+0000 7f36de895700 1 --2- 172.21.15.139:0/1085804621 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d80a6d90 0x7f36d814e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:30.943 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.936+0000 7f36de895700 1 --2- 172.21.15.139:0/1085804621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36d80a4140 0x7f36d80a4fd0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:30.943 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.936+0000 7f36de895700 1 -- 172.21.15.139:0/1085804621 >> 172.21.15.139:0/1085804621 conn(0x7f36d805a720 msgr2=0x7f36d805ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:30.943 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.937+0000 7f36de895700 1 -- 172.21.15.139:0/1085804621 shutdown_connections 2020-02-12T14:12:30.943 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.937+0000 7f36de895700 1 -- 172.21.15.139:0/1085804621 wait complete. 2020-02-12T14:12:30.944 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.938+0000 7f36de895700 1 Processor -- start 2020-02-12T14:12:30.944 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.938+0000 7f36de895700 1 -- start start 2020-02-12T14:12:30.947 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.938+0000 7f36de895700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d807fc00 0x7f36d80648a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:30.947 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.938+0000 7f36de895700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36d80a4140 0x7f36d8063040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:30.947 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.938+0000 7f36de895700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f36d80a6d90 0x7f36d8066050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:30.948 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.938+0000 7f36de895700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d80634a0 con 0x7f36d80a4140 2020-02-12T14:12:30.948 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.938+0000 7f36de895700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d80641d0 con 0x7f36d80a6d90 2020-02-12T14:12:30.948 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.938+0000 7f36de895700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d8066760 con 0x7f36d807fc00 2020-02-12T14:12:30.948 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.938+0000 7f36dd633700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f36d80a6d90 0x7f36d8066050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:30.948 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.938+0000 7f36dd633700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f36d80a6d90 0x7f36d8066050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46434/0 (socket says 172.21.15.139:46434) 2020-02-12T14:12:30.948 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.938+0000 7f36dd633700 1 -- 172.21.15.139:0/3631637609 learned_addr learned my addr 172.21.15.139:0/3631637609 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:30.948 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.938+0000 7f36d7fff700 1 --2- 172.21.15.139:0/3631637609 >> v2:172.21.15.72:3300/0 conn(0x7f36d80a4140 0x7f36d8063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:30.948 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.938+0000 7f36dce32700 1 --2- 172.21.15.139:0/3631637609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d807fc00 0x7f36d80648a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:30.949 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.939+0000 7f36dd633700 1 -- 172.21.15.139:0/3631637609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d807fc00 msgr2=0x7f36d80648a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:30.949 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.939+0000 7f36dd633700 1 --2- 172.21.15.139:0/3631637609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d807fc00 0x7f36d80648a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:30.949 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.939+0000 7f36dd633700 1 -- 172.21.15.139:0/3631637609 >> v2:172.21.15.72:3300/0 conn(0x7f36d80a4140 msgr2=0x7f36d8063040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:30.949 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.939+0000 7f36dd633700 1 --2- 172.21.15.139:0/3631637609 >> v2:172.21.15.72:3300/0 conn(0x7f36d80a4140 0x7f36d8063040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:30.949 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.939+0000 7f36dd633700 1 -- 172.21.15.139:0/3631637609 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d8064400 con 0x7f36d80a6d90 2020-02-12T14:12:30.949 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.939+0000 7f36d7fff700 1 --2- 172.21.15.139:0/3631637609 >> v2:172.21.15.72:3300/0 conn(0x7f36d80a4140 0x7f36d8063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T14:12:30.949 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.939+0000 7f36dce32700 1 --2- 172.21.15.139:0/3631637609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d807fc00 0x7f36d80648a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T14:12:30.950 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.939+0000 7f36dd633700 1 --2- 172.21.15.139:0/3631637609 >> v2:172.21.15.139:3300/0 conn(0x7f36d80a6d90 0x7f36d8066050 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f36d00032b0 tx=0x7f36d0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.950 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.939+0000 7f36dd633700 1 --2- 172.21.15.139:0/3631637609 >> v2:172.21.15.139:3300/0 conn(0x7f36d80a6d90 0x7f36d8066050 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f36d00032b0 tx=0x7f36d0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.950 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.939+0000 7f36dd633700 1 --2- 172.21.15.139:0/3631637609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36d80a6d90 0x7f36d8066050 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f36d00032b0 tx=0x7f36d0010ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:30.950 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.939+0000 7f36dd633700 1 --2- 172.21.15.139:0/3631637609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36d80a6d90 0x7f36d8066050 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f36d00032b0 tx=0x7f36d0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.950 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.939+0000 7f36dd633700 1 --2- 172.21.15.139:0/3631637609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36d80a6d90 0x7f36d8066050 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f36d00032b0 tx=0x7f36d0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.950 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.939+0000 7f36dd633700 1 --2- 172.21.15.139:0/3631637609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36d80a6d90 0x7f36d8066050 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f36d00032b0 tx=0x7f36d0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.951 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.939+0000 7f36d57fa700 1 -- 172.21.15.139:0/3631637609 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36d0012c40 con 0x7f36d80a6d90 2020-02-12T14:12:30.951 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.939+0000 7f36d57fa700 1 -- 172.21.15.139:0/3631637609 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d0012da0 con 0x7f36d80a6d90 2020-02-12T14:12:30.951 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.939+0000 7f36de895700 1 -- 172.21.15.139:0/3631637609 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d80664b0 con 0x7f36d80a6d90 2020-02-12T14:12:30.951 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.939+0000 7f36d57fa700 1 -- 172.21.15.139:0/3631637609 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36d000a350 con 0x7f36d80a6d90 2020-02-12T14:12:30.951 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.939+0000 7f36de895700 1 -- 172.21.15.139:0/3631637609 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d80624f0 con 0x7f36d80a6d90 2020-02-12T14:12:30.951 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.939+0000 7f36dd633700 1 --2- 172.21.15.139:0/3631637609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36d80a6d90 0x7f36d8066050 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f36d00032b0 tx=0x7f36d0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.951 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.940+0000 7f36d57fa700 1 -- 172.21.15.139:0/3631637609 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f36d000a5c0 con 0x7f36d80a6d90 2020-02-12T14:12:30.951 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.940+0000 7f36dd633700 1 --2- 172.21.15.139:0/3631637609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36d80a6d90 0x7f36d8066050 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f36d00032b0 tx=0x7f36d0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.952 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.940+0000 7f36de895700 1 -- 172.21.15.139:0/3631637609 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d8064600 con 0x7f36d80a6d90 2020-02-12T14:12:30.952 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.940+0000 7f36d57fa700 1 --2- 172.21.15.139:0/3631637609 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f36bc039c70 0x7f36bc03c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:30.952 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.940+0000 7f36d57fa700 1 -- 172.21.15.139:0/3631637609 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4500+0+0 (secure 0 0 0) 0x7f36d004a360 con 0x7f36d80a6d90 2020-02-12T14:12:30.952 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.940+0000 7f36dce32700 1 --2- 172.21.15.139:0/3631637609 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f36bc039c70 0x7f36bc03c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:30.952 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.940+0000 7f36dce32700 1 --2- 172.21.15.139:0/3631637609 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f36bc039c70 0x7f36bc03c130 crc :-1 s=READY pgs=34 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:30.952 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.943+0000 7f36dd633700 1 --2- 172.21.15.139:0/3631637609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36d80a6d90 0x7f36d8066050 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f36d00032b0 tx=0x7f36d0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:30.952 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:30.943+0000 7f36d57fa700 1 -- 172.21.15.139:0/3631637609 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f36d8064600 con 0x7f36d80a6d90 2020-02-12T14:12:31.080 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:31.079+0000 7f36de895700 1 -- 172.21.15.139:0/3631637609 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f36d8064600 con 0x7f36d80a6d90 2020-02-12T14:12:32.086 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.084+0000 7f36dd633700 1 --2- 172.21.15.139:0/3631637609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36d80a6d90 0x7f36d8066050 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f36d00032b0 tx=0x7f36d0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:32.086 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.084+0000 7f36d57fa700 1 -- 172.21.15.139:0/3631637609 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7f36d8064600 con 0x7f36d80a6d90 2020-02-12T14:12:32.089 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.086+0000 7f36de895700 1 -- 172.21.15.139:0/3631637609 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f36bc039c70 msgr2=0x7f36bc03c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:32.089 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.086+0000 7f36de895700 1 --2- 172.21.15.139:0/3631637609 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f36bc039c70 0x7f36bc03c130 crc :-1 s=READY pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:32.089 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.086+0000 7f36de895700 1 -- 172.21.15.139:0/3631637609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36d80a6d90 msgr2=0x7f36d8066050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:32.089 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.086+0000 7f36de895700 1 --2- 172.21.15.139:0/3631637609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36d80a6d90 0x7f36d8066050 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f36d00032b0 tx=0x7f36d0010ec0).stop 2020-02-12T14:12:32.089 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.086+0000 7f36de895700 1 -- 172.21.15.139:0/3631637609 shutdown_connections 2020-02-12T14:12:32.090 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.086+0000 7f36de895700 1 --2- 172.21.15.139:0/3631637609 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f36bc039c70 0x7f36bc03c130 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:32.090 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.086+0000 7f36de895700 1 --2- 172.21.15.139:0/3631637609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36d80a6d90 0x7f36d8066050 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:32.090 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.086+0000 7f36de895700 1 --2- 172.21.15.139:0/3631637609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d807fc00 0x7f36d80648a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:32.090 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.086+0000 7f36de895700 1 --2- 172.21.15.139:0/3631637609 >> v2:172.21.15.72:3300/0 conn(0x7f36d80a4140 0x7f36d8063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:32.090 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.086+0000 7f36de895700 1 -- 172.21.15.139:0/3631637609 >> 172.21.15.139:0/3631637609 conn(0x7f36d805a720 msgr2=0x7f36d805e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:32.090 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.087+0000 7f36de895700 1 -- 172.21.15.139:0/3631637609 shutdown_connections 2020-02-12T14:12:32.090 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.087+0000 7f36de895700 1 -- 172.21.15.139:0/3631637609 wait complete. 2020-02-12T14:12:32.091 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'rbd' created 2020-02-12T14:12:32.101 INFO:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-02-12T14:12:32.216 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.210+0000 7ffb553f3700 1 Processor -- start 2020-02-12T14:12:32.216 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.210+0000 7ffb553f3700 1 -- start start 2020-02-12T14:12:32.216 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.210+0000 7ffb553f3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb5007fc00 0x7ffb500a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:32.216 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.210+0000 7ffb553f3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb5009a700 con 0x7ffb500a6d90 2020-02-12T14:12:32.216 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.210+0000 7ffb553f3700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb500a5520 con 0x7ffb500a4140 2020-02-12T14:12:32.216 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.210+0000 7ffb553f3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb500a57c0 con 0x7ffb5007fc00 2020-02-12T14:12:32.217 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.211+0000 7ffb4f7fe700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7ffb500a4140 0x7ffb500a6680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35076/0 (socket says 172.21.15.139:35076) 2020-02-12T14:12:32.217 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.211+0000 7ffb4f7fe700 1 -- 172.21.15.139:0/3970477859 learned_addr learned my addr 172.21.15.139:0/3970477859 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:32.217 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.211+0000 7ffb4effd700 1 --2- 172.21.15.139:0/3970477859 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb5007fc00 0x7ffb500a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:32.217 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.211+0000 7ffb4e7fc700 1 -- 172.21.15.139:0/3970477859 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2080744720 0 0) 0x7ffb500a5520 con 0x7ffb500a4140 2020-02-12T14:12:32.217 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.211+0000 7ffb4e7fc700 1 -- 172.21.15.139:0/3970477859 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb38003230 con 0x7ffb500a4140 2020-02-12T14:12:32.217 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.211+0000 7ffb4e7fc700 1 -- 172.21.15.139:0/3970477859 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2198603564 0 0) 0x7ffb38003230 con 0x7ffb500a4140 2020-02-12T14:12:32.217 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.211+0000 7ffb4e7fc700 1 -- 172.21.15.139:0/3970477859 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb5007fc00 msgr2=0x7ffb500a4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:32.218 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.211+0000 7ffb4e7fc700 1 --2- 172.21.15.139:0/3970477859 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb5007fc00 0x7ffb500a4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:32.218 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.211+0000 7ffb4e7fc700 1 -- 172.21.15.139:0/3970477859 >> v1:172.21.15.72:6789/0 conn(0x7ffb500a6d90 legacy=0x7ffb5014e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:32.218 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.211+0000 7ffb4e7fc700 1 -- 172.21.15.139:0/3970477859 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb501520d0 con 0x7ffb500a4140 2020-02-12T14:12:32.218 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.211+0000 7ffb4e7fc700 1 -- 172.21.15.139:0/3970477859 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7ffb40001a90 con 0x7ffb500a4140 2020-02-12T14:12:32.218 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.211+0000 7ffb4e7fc700 1 -- 172.21.15.139:0/3970477859 >> v1:172.21.15.139:6789/0 conn(0x7ffb500a4140 legacy=0x7ffb500a6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:32.218 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.211+0000 7ffb4e7fc700 1 --2- 172.21.15.139:0/3970477859 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb5007fc00 0x7ffb38003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:32.218 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.211+0000 7ffb4e7fc700 1 --2- 172.21.15.139:0/3970477859 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb38003bb0 0x7ffb38004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:32.218 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.211+0000 7ffb4e7fc700 1 --2- 172.21.15.139:0/3970477859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb380045e0 0x7ffb38004a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:32.219 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.211+0000 7ffb4e7fc700 1 -- 172.21.15.139:0/3970477859 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb500a57c0 con 0x7ffb380045e0 2020-02-12T14:12:32.219 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.211+0000 7ffb4e7fc700 1 -- 172.21.15.139:0/3970477859 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb38005010 con 0x7ffb38003bb0 2020-02-12T14:12:32.219 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.211+0000 7ffb4e7fc700 1 -- 172.21.15.139:0/3970477859 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb380051d0 con 0x7ffb5007fc00 2020-02-12T14:12:32.219 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.211+0000 7ffb4effd700 1 --2- 172.21.15.139:0/3970477859 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb38003bb0 0x7ffb38004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:32.219 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.211+0000 7ffb4f7fe700 1 --2- 172.21.15.139:0/3970477859 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb5007fc00 0x7ffb38003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:32.219 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.211+0000 7ffb4ffff700 1 --2- 172.21.15.139:0/3970477859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb380045e0 0x7ffb38004a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:32.219 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.211+0000 7ffb4effd700 1 -- 172.21.15.139:0/3970477859 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb5007fc00 msgr2=0x7ffb38003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:32.220 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.211+0000 7ffb4effd700 1 --2- 172.21.15.139:0/3970477859 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb5007fc00 0x7ffb38003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:32.220 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.211+0000 7ffb4effd700 1 -- 172.21.15.139:0/3970477859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb380045e0 msgr2=0x7ffb38004a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:32.220 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.211+0000 7ffb4effd700 1 --2- 172.21.15.139:0/3970477859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb380045e0 0x7ffb38004a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:32.220 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.212+0000 7ffb4effd700 1 -- 172.21.15.139:0/3970477859 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb38003230 con 0x7ffb38003bb0 2020-02-12T14:12:32.220 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.212+0000 7ffb4effd700 1 --2- 172.21.15.139:0/3970477859 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb38003bb0 0x7ffb38004010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffb44008910 tx=0x7ffb44010130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:32.220 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.212+0000 7ffb4effd700 1 --2- 172.21.15.139:0/3970477859 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb38003bb0 0x7ffb38004010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffb44008910 tx=0x7ffb44010130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:32.220 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.212+0000 7ffb4effd700 1 --2- 172.21.15.139:0/3970477859 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb38003bb0 0x7ffb38004010 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7ffb44008910 tx=0x7ffb44010130).ready entity=mon.1 client_cookie=5624e20946559235 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:32.220 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.212+0000 7ffb4effd700 1 --2- 172.21.15.139:0/3970477859 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb38003bb0 0x7ffb38004010 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7ffb44008910 tx=0x7ffb44010130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:32.221 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.212+0000 7ffb4e7fc700 1 -- 172.21.15.139:0/3970477859 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb44010e00 con 0x7ffb38003bb0 2020-02-12T14:12:32.221 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.212+0000 7ffb4effd700 1 --2- 172.21.15.139:0/3970477859 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb38003bb0 0x7ffb38004010 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7ffb44008910 tx=0x7ffb44010130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:32.221 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.212+0000 7ffb4e7fc700 1 -- 172.21.15.139:0/3970477859 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb44008950 con 0x7ffb38003bb0 2020-02-12T14:12:32.221 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.212+0000 7ffb4effd700 1 --2- 172.21.15.139:0/3970477859 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb38003bb0 0x7ffb38004010 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7ffb44008910 tx=0x7ffb44010130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:32.221 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.212+0000 7ffb4e7fc700 1 -- 172.21.15.139:0/3970477859 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb44008cf0 con 0x7ffb38003bb0 2020-02-12T14:12:32.221 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.212+0000 7ffb553f3700 1 -- 172.21.15.139:0/3970477859 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb38003bb0 msgr2=0x7ffb38004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:32.221 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.212+0000 7ffb553f3700 1 --2- 172.21.15.139:0/3970477859 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb38003bb0 0x7ffb38004010 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7ffb44008910 tx=0x7ffb44010130).stop 2020-02-12T14:12:32.222 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.212+0000 7ffb4ffff700 1 -- 172.21.15.139:0/3970477859 reap_dead start 2020-02-12T14:12:32.222 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.212+0000 7ffb553f3700 1 -- 172.21.15.139:0/3970477859 shutdown_connections 2020-02-12T14:12:32.222 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.212+0000 7ffb553f3700 1 -- 172.21.15.139:0/3970477859 >> 172.21.15.139:0/3970477859 conn(0x7ffb5005a720 msgr2=0x7ffb5005ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:32.222 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.212+0000 7ffb553f3700 1 -- 172.21.15.139:0/3970477859 shutdown_connections 2020-02-12T14:12:32.222 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.212+0000 7ffb553f3700 1 -- 172.21.15.139:0/3970477859 wait complete. 2020-02-12T14:12:32.222 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.213+0000 7ffb553f3700 1 Processor -- start 2020-02-12T14:12:32.222 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.214+0000 7ffb553f3700 1 -- start start 2020-02-12T14:12:32.225 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.214+0000 7ffb553f3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffb5009f9a0 0x7ffb50121440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:32.226 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.214+0000 7ffb553f3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb50124790 0x7ffb500a8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:32.226 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.214+0000 7ffb553f3700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb500a77f0 con 0x7ffb50126530 2020-02-12T14:12:32.226 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.214+0000 7ffb553f3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb501243e0 con 0x7ffb5009f9a0 2020-02-12T14:12:32.226 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.214+0000 7ffb553f3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb50122a30 con 0x7ffb50124790 2020-02-12T14:12:32.226 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.214+0000 7ffb4effd700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7ffb50126530 0x7ffb500a8130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35088/0 (socket says 172.21.15.139:35088) 2020-02-12T14:12:32.226 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.214+0000 7ffb4effd700 1 -- 172.21.15.139:0/1923113312 learned_addr learned my addr 172.21.15.139:0/1923113312 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:32.226 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.214+0000 7ffb4f7fe700 1 --2- 172.21.15.139:0/1923113312 >> v2:172.21.15.72:3300/0 conn(0x7ffb5009f9a0 0x7ffb50121440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:32.227 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.214+0000 7ffb4ffff700 1 --2- 172.21.15.139:0/1923113312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb50124790 0x7ffb500a8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:32.227 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.214+0000 7ffb37fff700 1 -- 172.21.15.139:0/1923113312 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2524895599 0 0) 0x7ffb500a77f0 con 0x7ffb50126530 2020-02-12T14:12:32.227 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.214+0000 7ffb37fff700 1 -- 172.21.15.139:0/1923113312 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb30003230 con 0x7ffb50126530 2020-02-12T14:12:32.227 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.215+0000 7ffb37fff700 1 -- 172.21.15.139:0/1923113312 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1479789472 0 0) 0x7ffb30003230 con 0x7ffb50126530 2020-02-12T14:12:32.227 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.215+0000 7ffb4ffff700 1 -- 172.21.15.139:0/1923113312 >> v2:172.21.15.72:3300/0 conn(0x7ffb5009f9a0 msgr2=0x7ffb50121440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:32.227 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.215+0000 7ffb4ffff700 1 --2- 172.21.15.139:0/1923113312 >> v2:172.21.15.72:3300/0 conn(0x7ffb5009f9a0 0x7ffb50121440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:32.227 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.215+0000 7ffb4ffff700 1 -- 172.21.15.139:0/1923113312 >> v1:172.21.15.139:6789/0 conn(0x7ffb50126530 legacy=0x7ffb500a8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:32.228 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.215+0000 7ffb4ffff700 1 -- 172.21.15.139:0/1923113312 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb501227d0 con 0x7ffb50124790 2020-02-12T14:12:32.228 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.215+0000 7ffb4ffff700 1 --2- 172.21.15.139:0/1923113312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb50124790 0x7ffb500a8840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffb44007950 tx=0x7ffb48010590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:32.228 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.215+0000 7ffb4ffff700 1 --2- 172.21.15.139:0/1923113312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb50124790 0x7ffb500a8840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffb44007950 tx=0x7ffb48010590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:32.228 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.215+0000 7ffb4ffff700 1 --2- 172.21.15.139:0/1923113312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb50124790 0x7ffb500a8840 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7ffb44007950 tx=0x7ffb48010590).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:32.228 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.215+0000 7ffb4ffff700 1 --2- 172.21.15.139:0/1923113312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb50124790 0x7ffb500a8840 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7ffb44007950 tx=0x7ffb48010590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:32.228 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.215+0000 7ffb37fff700 1 -- 172.21.15.139:0/1923113312 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb440077f0 con 0x7ffb50124790 2020-02-12T14:12:32.228 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.215+0000 7ffb4ffff700 1 --2- 172.21.15.139:0/1923113312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb50124790 0x7ffb500a8840 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7ffb44007950 tx=0x7ffb48010590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:32.228 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.215+0000 7ffb553f3700 1 -- 172.21.15.139:0/1923113312 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb50122230 con 0x7ffb50124790 2020-02-12T14:12:32.229 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.215+0000 7ffb37fff700 1 -- 172.21.15.139:0/1923113312 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb48010bc0 con 0x7ffb50124790 2020-02-12T14:12:32.229 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.215+0000 7ffb4ffff700 1 --2- 172.21.15.139:0/1923113312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb50124790 0x7ffb500a8840 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7ffb44007950 tx=0x7ffb48010590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:32.229 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.215+0000 7ffb37fff700 1 -- 172.21.15.139:0/1923113312 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb480017a0 con 0x7ffb50124790 2020-02-12T14:12:32.229 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.215+0000 7ffb553f3700 1 -- 172.21.15.139:0/1923113312 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb50122550 con 0x7ffb50124790 2020-02-12T14:12:32.229 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.216+0000 7ffb4ffff700 1 --2- 172.21.15.139:0/1923113312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb50124790 0x7ffb500a8840 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7ffb44007950 tx=0x7ffb48010590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:32.229 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.216+0000 7ffb553f3700 1 -- 172.21.15.139:0/1923113312 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb50067e20 con 0x7ffb50124790 2020-02-12T14:12:32.229 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.216+0000 7ffb37fff700 1 -- 172.21.15.139:0/1923113312 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7ffb48001900 con 0x7ffb50124790 2020-02-12T14:12:32.229 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.216+0000 7ffb4ffff700 1 --2- 172.21.15.139:0/1923113312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb50124790 0x7ffb500a8840 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7ffb44007950 tx=0x7ffb48010590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:32.230 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.216+0000 7ffb37fff700 1 --2- 172.21.15.139:0/1923113312 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7ffb30039f00 0x7ffb3003c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:32.230 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.216+0000 7ffb37fff700 1 -- 172.21.15.139:0/1923113312 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4842+0+0 (secure 0 0 0) 0x7ffb48048960 con 0x7ffb50124790 2020-02-12T14:12:32.230 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.216+0000 7ffb4f7fe700 1 --2- 172.21.15.139:0/1923113312 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7ffb30039f00 0x7ffb3003c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:32.230 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.217+0000 7ffb4f7fe700 1 --2- 172.21.15.139:0/1923113312 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7ffb30039f00 0x7ffb3003c3c0 crc :-1 s=READY pgs=35 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:32.230 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.220+0000 7ffb4ffff700 1 --2- 172.21.15.139:0/1923113312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb50124790 0x7ffb500a8840 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7ffb44007950 tx=0x7ffb48010590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:32.230 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.220+0000 7ffb37fff700 1 -- 172.21.15.139:0/1923113312 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7ffb4802e050 con 0x7ffb50124790 2020-02-12T14:12:32.359 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:32.357+0000 7ffb553f3700 1 -- 172.21.15.139:0/1923113312 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ffb50124530 con 0x7ffb50124790 2020-02-12T14:12:33.085 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.083+0000 7ffb4ffff700 1 --2- 172.21.15.139:0/1923113312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb50124790 0x7ffb500a8840 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7ffb44007950 tx=0x7ffb48010590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.085 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.083+0000 7ffb37fff700 1 -- 172.21.15.139:0/1923113312 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7ffb48030b40 con 0x7ffb50124790 2020-02-12T14:12:33.089 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.087+0000 7ffb553f3700 1 -- 172.21.15.139:0/1923113312 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7ffb30039f00 msgr2=0x7ffb3003c3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:33.090 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.087+0000 7ffb553f3700 1 --2- 172.21.15.139:0/1923113312 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7ffb30039f00 0x7ffb3003c3c0 crc :-1 s=READY pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:33.090 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.087+0000 7ffb553f3700 1 -- 172.21.15.139:0/1923113312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb50124790 msgr2=0x7ffb500a8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:33.090 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.087+0000 7ffb553f3700 1 --2- 172.21.15.139:0/1923113312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb50124790 0x7ffb500a8840 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7ffb44007950 tx=0x7ffb48010590).stop 2020-02-12T14:12:33.090 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.088+0000 7ffb553f3700 1 -- 172.21.15.139:0/1923113312 shutdown_connections 2020-02-12T14:12:33.091 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.088+0000 7ffb553f3700 1 --2- 172.21.15.139:0/1923113312 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7ffb30039f00 0x7ffb3003c3c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:33.091 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.088+0000 7ffb553f3700 1 --2- 172.21.15.139:0/1923113312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb50124790 0x7ffb500a8840 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:33.091 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.088+0000 7ffb553f3700 1 --2- 172.21.15.139:0/1923113312 >> v2:172.21.15.72:3300/0 conn(0x7ffb5009f9a0 0x7ffb50121440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:33.091 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.088+0000 7ffb553f3700 1 -- 172.21.15.139:0/1923113312 >> 172.21.15.139:0/1923113312 conn(0x7ffb5005a720 msgr2=0x7ffb500a2310 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:33.091 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.088+0000 7ffb553f3700 1 -- 172.21.15.139:0/1923113312 shutdown_connections 2020-02-12T14:12:33.091 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.088+0000 7ffb553f3700 1 -- 172.21.15.139:0/1923113312 wait complete. 2020-02-12T14:12:33.092 INFO:teuthology.orchestra.run.smithi139.stderr:enabled application 'rbd' on pool 'rbd' 2020-02-12T14:12:33.103 INFO:tasks.ceph:Setting up CephFS filesystem... 2020-02-12T14:12:33.103 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-12T14:12:33.214 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.211+0000 7f3775234700 1 Processor -- start 2020-02-12T14:12:33.214 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.211+0000 7f3775234700 1 -- start start 2020-02-12T14:12:33.217 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.212+0000 7f3775234700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f377005aaa0 0x7f3770135e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:33.217 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.212+0000 7f3775234700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3770139f90 0x7f37701407c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:33.217 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.212+0000 7f3775234700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377009d530 con 0x7f3770139420 2020-02-12T14:12:33.218 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.212+0000 7f3775234700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37700a8f10 con 0x7f3770139f90 2020-02-12T14:12:33.218 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.212+0000 7f3775234700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377009f020 con 0x7f377005aaa0 2020-02-12T14:12:33.218 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.213+0000 7f376f59e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3770139f90 0x7f37701407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:33.218 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.213+0000 7f376ed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f377005aaa0 0x7f3770135e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:33.218 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.213+0000 7f376f59e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3770139f90 0x7f37701407c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.139:49366/0 (socket says 172.21.15.139:49366) 2020-02-12T14:12:33.218 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.213+0000 7f376f59e700 1 -- 172.21.15.139:0/2217102634 learned_addr learned my addr 172.21.15.139:0/2217102634 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:33.218 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.213+0000 7f376e59c700 1 --1- 172.21.15.139:0/2217102634 >> v1:172.21.15.72:6789/0 conn(0x7f3770139420 0x7f3770139880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.139:48968/0 (socket says 172.21.15.139:48968) 2020-02-12T14:12:33.218 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.213+0000 7f376f59e700 1 -- 172.21.15.139:0/2217102634 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f377005aaa0 msgr2=0x7f3770135e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:33.219 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.213+0000 7f376f59e700 1 --2- 172.21.15.139:0/2217102634 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f377005aaa0 0x7f3770135e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:33.219 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.213+0000 7f376f59e700 1 -- 172.21.15.139:0/2217102634 >> v1:172.21.15.72:6789/0 conn(0x7f3770139420 legacy=0x7f3770139880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:33.219 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.213+0000 7f376f59e700 1 -- 172.21.15.139:0/2217102634 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377009d760 con 0x7f3770139f90 2020-02-12T14:12:33.219 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.213+0000 7f376dd9b700 1 -- 172.21.15.139:0/2217102634 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2658251338 0 0) 0x7f377009d530 con 0x7f3770139420 2020-02-12T14:12:33.219 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.213+0000 7f376ed9d700 1 --2- 172.21.15.139:0/2217102634 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f377005aaa0 0x7f3770135e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T14:12:33.219 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.213+0000 7f376f59e700 1 --2- 172.21.15.139:0/2217102634 >> v2:172.21.15.72:3300/0 conn(0x7f3770139f90 0x7f37701407c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f37680032b0 tx=0x7f3768008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.219 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.213+0000 7f376f59e700 1 --2- 172.21.15.139:0/2217102634 >> v2:172.21.15.72:3300/0 conn(0x7f3770139f90 0x7f37701407c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f37680032b0 tx=0x7f3768008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.219 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.213+0000 7f376f59e700 1 --2- 172.21.15.139:0/2217102634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3770139f90 0x7f37701407c0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f37680032b0 tx=0x7f3768008c60).ready entity=mon.0 client_cookie=5c507efb6040cc7d server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:33.220 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.213+0000 7f376f59e700 1 --2- 172.21.15.139:0/2217102634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3770139f90 0x7f37701407c0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f37680032b0 tx=0x7f3768008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.220 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.213+0000 7f376dd9b700 1 -- 172.21.15.139:0/2217102634 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f376800a160 con 0x7f3770139f90 2020-02-12T14:12:33.220 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.213+0000 7f376f59e700 1 --2- 172.21.15.139:0/2217102634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3770139f90 0x7f37701407c0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f37680032b0 tx=0x7f3768008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.220 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.213+0000 7f376dd9b700 1 -- 172.21.15.139:0/2217102634 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376800a2c0 con 0x7f3770139f90 2020-02-12T14:12:33.220 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.213+0000 7f376f59e700 1 --2- 172.21.15.139:0/2217102634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3770139f90 0x7f37701407c0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f37680032b0 tx=0x7f3768008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.220 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.213+0000 7f376dd9b700 1 -- 172.21.15.139:0/2217102634 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f376800a660 con 0x7f3770139f90 2020-02-12T14:12:33.220 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.213+0000 7f3775234700 1 -- 172.21.15.139:0/2217102634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3770139f90 msgr2=0x7f37701407c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:33.221 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.213+0000 7f3775234700 1 --2- 172.21.15.139:0/2217102634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3770139f90 0x7f37701407c0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f37680032b0 tx=0x7f3768008c60).stop 2020-02-12T14:12:33.221 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.214+0000 7f3775234700 1 -- 172.21.15.139:0/2217102634 shutdown_connections 2020-02-12T14:12:33.221 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.214+0000 7f3775234700 1 --2- 172.21.15.139:0/2217102634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3770139f90 0x7f37701407c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:33.221 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.214+0000 7f3775234700 1 --2- 172.21.15.139:0/2217102634 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f377005aaa0 0x7f3770135e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:33.221 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.214+0000 7f3775234700 1 -- 172.21.15.139:0/2217102634 >> 172.21.15.139:0/2217102634 conn(0x7f37700ac620 msgr2=0x7f37700aca30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:33.221 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.214+0000 7f3775234700 1 -- 172.21.15.139:0/2217102634 shutdown_connections 2020-02-12T14:12:33.221 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.214+0000 7f3775234700 1 -- 172.21.15.139:0/2217102634 wait complete. 2020-02-12T14:12:33.221 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.215+0000 7f3775234700 1 Processor -- start 2020-02-12T14:12:33.222 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.215+0000 7f3775234700 1 -- start start 2020-02-12T14:12:33.225 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.215+0000 7f3775234700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f377005aaa0 0x7f3770138220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:33.225 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.215+0000 7f3775234700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3770137df0 con 0x7f3770139420 2020-02-12T14:12:33.225 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.215+0000 7f3775234700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377012d560 con 0x7f3770139f90 2020-02-12T14:12:33.226 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.215+0000 7f3775234700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3770131730 con 0x7f377005aaa0 2020-02-12T14:12:33.226 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.215+0000 7f376ed9d700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f377005aaa0 0x7f3770138220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:33.226 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.215+0000 7f376f59e700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f3770139f90 0x7f377014dc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35102/0 (socket says 172.21.15.139:35102) 2020-02-12T14:12:33.226 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.215+0000 7f376ed9d700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f377005aaa0 0x7f3770138220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46460/0 (socket says 172.21.15.139:46460) 2020-02-12T14:12:33.226 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.215+0000 7f376f59e700 1 -- 172.21.15.139:0/1795749164 learned_addr learned my addr 172.21.15.139:0/1795749164 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:33.226 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.216+0000 7f376ed9d700 1 -- 172.21.15.139:0/1795749164 >> v1:172.21.15.139:6789/0 conn(0x7f3770139f90 legacy=0x7f377014dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:33.226 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.216+0000 7f3767fff700 1 -- 172.21.15.139:0/1795749164 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532496234 0 0) 0x7f3770137df0 con 0x7f3770139420 2020-02-12T14:12:33.227 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.216+0000 7f376ed9d700 1 -- 172.21.15.139:0/1795749164 >> v1:172.21.15.72:6789/0 conn(0x7f3770139420 legacy=0x7f3770146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:33.227 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.216+0000 7f376ed9d700 1 -- 172.21.15.139:0/1795749164 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37701319d0 con 0x7f377005aaa0 2020-02-12T14:12:33.227 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.216+0000 7f376ed9d700 1 --2- 172.21.15.139:0/1795749164 >> v2:172.21.15.139:3300/0 conn(0x7f377005aaa0 0x7f3770138220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3768008840 tx=0x7f3760010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.227 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.216+0000 7f376ed9d700 1 --2- 172.21.15.139:0/1795749164 >> v2:172.21.15.139:3300/0 conn(0x7f377005aaa0 0x7f3770138220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3768008840 tx=0x7f3760010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.227 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.216+0000 7f376ed9d700 1 --2- 172.21.15.139:0/1795749164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f377005aaa0 0x7f3770138220 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f3768008840 tx=0x7f3760010da0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:33.227 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.216+0000 7f376ed9d700 1 --2- 172.21.15.139:0/1795749164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f377005aaa0 0x7f3770138220 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f3768008840 tx=0x7f3760010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.227 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.216+0000 7f3767fff700 1 -- 172.21.15.139:0/1795749164 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3760007540 con 0x7f377005aaa0 2020-02-12T14:12:33.228 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.216+0000 7f376ed9d700 1 --2- 172.21.15.139:0/1795749164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f377005aaa0 0x7f3770138220 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f3768008840 tx=0x7f3760010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.228 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.216+0000 7f376ed9d700 1 --2- 172.21.15.139:0/1795749164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f377005aaa0 0x7f3770138220 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f3768008840 tx=0x7f3760010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.228 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.216+0000 7f3767fff700 1 -- 172.21.15.139:0/1795749164 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37600059c0 con 0x7f377005aaa0 2020-02-12T14:12:33.228 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.216+0000 7f3775234700 1 -- 172.21.15.139:0/1795749164 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3770137740 con 0x7f377005aaa0 2020-02-12T14:12:33.228 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.216+0000 7f3767fff700 1 -- 172.21.15.139:0/1795749164 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3760005da0 con 0x7f377005aaa0 2020-02-12T14:12:33.228 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.216+0000 7f3775234700 1 -- 172.21.15.139:0/1795749164 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3770131300 con 0x7f377005aaa0 2020-02-12T14:12:33.228 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.216+0000 7f376ed9d700 1 --2- 172.21.15.139:0/1795749164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f377005aaa0 0x7f3770138220 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f3768008840 tx=0x7f3760010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.228 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.217+0000 7f3767fff700 1 -- 172.21.15.139:0/1795749164 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f3760009440 con 0x7f377005aaa0 2020-02-12T14:12:33.229 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.217+0000 7f376ed9d700 1 --2- 172.21.15.139:0/1795749164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f377005aaa0 0x7f3770138220 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f3768008840 tx=0x7f3760010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.229 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.217+0000 7f3775234700 1 -- 172.21.15.139:0/1795749164 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3770067e20 con 0x7f377005aaa0 2020-02-12T14:12:33.229 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.217+0000 7f3767fff700 1 --2- 172.21.15.139:0/1795749164 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f3754039ae0 0x7f375403bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:33.229 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.217+0000 7f3767fff700 1 -- 172.21.15.139:0/1795749164 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3760049e40 con 0x7f377005aaa0 2020-02-12T14:12:33.229 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.217+0000 7f376e59c700 1 --2- 172.21.15.139:0/1795749164 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f3754039ae0 0x7f375403bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:33.229 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.217+0000 7f376e59c700 1 --2- 172.21.15.139:0/1795749164 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f3754039ae0 0x7f375403bfa0 crc :-1 s=READY pgs=36 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:33.229 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.220+0000 7f376ed9d700 1 --2- 172.21.15.139:0/1795749164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f377005aaa0 0x7f3770138220 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f3768008840 tx=0x7f3760010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.230 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.220+0000 7f3767fff700 1 -- 172.21.15.139:0/1795749164 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f376002f4d0 con 0x7f377005aaa0 2020-02-12T14:12:33.358 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.356+0000 7f3775234700 1 -- 172.21.15.139:0/1795749164 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3770059fd0 con 0x7f377005aaa0 2020-02-12T14:12:33.358 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.356+0000 7f376ed9d700 1 --2- 172.21.15.139:0/1795749164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f377005aaa0 0x7f3770138220 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f3768008840 tx=0x7f3760010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.359 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.356+0000 7f3767fff700 1 -- 172.21.15.139:0/1795749164 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11826 (secure 0 0 0) 0x7f3760031f80 con 0x7f377005aaa0 2020-02-12T14:12:33.359 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:12:33.359 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":16,"fsid":"dacc9a6c-9e88-46ac-940b-c4a329dbffec","created":"2020-02-12T14:12:18.258232+0000","modified":"2020-02-12T14:12:33.079705+0000","last_up_change":"2020-02-12T14:12:27.050924+0000","last_in_change":"2020-02-12T14:12:27.050924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-12T14:12:31.091380+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ffc0664d-9b93-45a4-a454-7655ee26d582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":22147},{"type":"v1","addr":"172.21.15.139:6803","nonce":22147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":22147},{"type":"v1","addr":"172.21.15.139:6805","nonce":22147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":22147},{"type":"v1","addr":"172.21.15.139:6809","nonce":22147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":22147},{"type":"v1","addr":"172.21.15.139:6807","nonce":22147}]},"public_addr":"172.21.15.139:6803/22147","cluster_addr":"172.21.15.139:6805/22147","heartbeat_back_addr":"172.21.15.139:6809/22147","heartbeat_front_addr":"172.21.15.139:6807/22147","state":["exists","up"]},{"osd":1,"uuid":"f66da6bc-43b3-4846-85f9-a25e3fe95216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":22148},{"type":"v1","addr":"172.21.15.139:6811","nonce":22148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":22148},{"type":"v1","addr":"172.21.15.139:6813","nonce":22148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6819","nonce":22148},{"type":"v1","addr":"172.21.15.139:6821","nonce":22148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6815","nonce":22148},{"type":"v1","addr":"172.21.15.139:6817","nonce":22148}]},"public_addr":"172.21.15.139:6811/22148","cluster_addr":"172.21.15.139:6813/22148","heartbeat_back_addr":"172.21.15.139:6821/22148","heartbeat_front_addr":"172.21.15.139:6817/22148","state":["exists","up"]},{"osd":2,"uuid":"c35fb293-3e16-41e8-85f3-768e11e55b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":22149},{"type":"v1","addr":"172.21.15.139:6827","nonce":22149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":22149},{"type":"v1","addr":"172.21.15.139:6829","nonce":22149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":22149},{"type":"v1","addr":"172.21.15.139:6833","nonce":22149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":22149},{"type":"v1","addr":"172.21.15.139:6831","nonce":22149}]},"public_addr":"172.21.15.139:6827/22149","cluster_addr":"172.21.15.139:6829/22149","heartbeat_back_addr":"172.21.15.139:6833/22149","heartbeat_front_addr":"172.21.15.139:6831/22149","state":["exists","up"]},{"osd":3,"uuid":"bc8b2c0d-e3dd-48cb-883e-6ea965aee923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":22150},{"type":"v1","addr":"172.21.15.139:6816","nonce":22150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":22150},{"type":"v1","addr":"172.21.15.139:6820","nonce":22150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":22150},{"type":"v1","addr":"172.21.15.139:6825","nonce":22150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":22150},{"type":"v1","addr":"172.21.15.139:6823","nonce":22150}]},"public_addr":"172.21.15.139:6816/22150","cluster_addr":"172.21.15.139:6820/22150","heartbeat_back_addr":"172.21.15.139:6825/22150","heartbeat_front_addr":"172.21.15.139:6823/22150","state":["exists","up"]},{"osd":4,"uuid":"aadfc406-0c40-4b6b-9e19-c92b2f40264a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":21598},{"type":"v1","addr":"172.21.15.72:6801","nonce":21598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":21598},{"type":"v1","addr":"172.21.15.72:6803","nonce":21598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":21598},{"type":"v1","addr":"172.21.15.72:6807","nonce":21598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":21598},{"type":"v1","addr":"172.21.15.72:6805","nonce":21598}]},"public_addr":"172.21.15.72:6801/21598","cluster_addr":"172.21.15.72:6803/21598","heartbeat_back_addr":"172.21.15.72:6807/21598","heartbeat_front_addr":"172.21.15.72:6805/21598","state":["exists","up"]},{"osd":5,"uuid":"3296dc8e-9322-4430-abd2-7672da5b7acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":21599},{"type":"v1","addr":"172.21.15.72:6810","nonce":21599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":21599},{"type":"v1","addr":"172.21.15.72:6815","nonce":21599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":21599},{"type":"v1","addr":"172.21.15.72:6823","nonce":21599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":21599},{"type":"v1","addr":"172.21.15.72:6820","nonce":21599}]},"public_addr":"172.21.15.72:6810/21599","cluster_addr":"172.21.15.72:6815/21599","heartbeat_back_addr":"172.21.15.72:6823/21599","heartbeat_front_addr":"172.21.15.72:6820/21599","state":["exists","up"]},{"osd":6,"uuid":"7c39cf20-a3a8-4d56-8577-f4102b302a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":21601},{"type":"v1","addr":"172.21.15.72:6811","nonce":21601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":21601},{"type":"v1","addr":"172.21.15.72:6814","nonce":21601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":21601},{"type":"v1","addr":"172.21.15.72:6821","nonce":21601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":21601},{"type":"v1","addr":"172.21.15.72:6818","nonce":21601}]},"public_addr":"172.21.15.72:6811/21601","cluster_addr":"172.21.15.72:6814/21601","heartbeat_back_addr":"172.21.15.72:6821/21601","heartbeat_front_addr":"172.21.15.72:6818/21601","state":["exists","up"]},{"osd":7,"uuid":"f452adff-8432-47e9-a5f1-9fd7e2a04a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":21600},{"type":"v1","addr":"172.21.15.72:6825","nonce":21600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":21600},{"type":"v1","addr":"172.21.15.72:6827","nonce":21600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":21600},{"type":"v1","addr":"172.21.15.72:6831","nonce":21600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":21600},{"type":"v1","addr":"172.21.15.72:6829","nonce":21600}]},"public_addr":"172.21.15.72:6825/21600","cluster_addr":"172.21.15.72:6827/21600","heartbeat_back_addr":"172.21.15.72:6831/21600","heartbeat_front_addr":"172.21.15.72:6829/21600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.259782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.267019+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.315501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.326256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.335328+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.284130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.083179+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.351445+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-12T14:12:33.360 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.358+0000 7f3775234700 1 -- 172.21.15.139:0/1795749164 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f3754039ae0 msgr2=0x7f375403bfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:33.360 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.358+0000 7f3775234700 1 --2- 172.21.15.139:0/1795749164 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f3754039ae0 0x7f375403bfa0 crc :-1 s=READY pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:33.360 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.358+0000 7f3775234700 1 -- 172.21.15.139:0/1795749164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f377005aaa0 msgr2=0x7f3770138220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:33.361 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.358+0000 7f3775234700 1 --2- 172.21.15.139:0/1795749164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f377005aaa0 0x7f3770138220 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f3768008840 tx=0x7f3760010da0).stop 2020-02-12T14:12:33.361 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.358+0000 7f3775234700 1 -- 172.21.15.139:0/1795749164 shutdown_connections 2020-02-12T14:12:33.361 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.358+0000 7f3775234700 1 --2- 172.21.15.139:0/1795749164 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f3754039ae0 0x7f375403bfa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:33.361 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.358+0000 7f3775234700 1 --2- 172.21.15.139:0/1795749164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f377005aaa0 0x7f3770138220 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:33.361 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.358+0000 7f3775234700 1 -- 172.21.15.139:0/1795749164 >> 172.21.15.139:0/1795749164 conn(0x7f37700ac620 msgr2=0x7f377005e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:33.361 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.358+0000 7f3775234700 1 -- 172.21.15.139:0/1795749164 shutdown_connections 2020-02-12T14:12:33.361 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.358+0000 7f3775234700 1 -- 172.21.15.139:0/1795749164 wait complete. 2020-02-12T14:12:33.370 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-12T14:12:31.091380+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'16', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-02-12T14:12:33.371 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-02-12T14:12:33.478 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.476+0000 7f74d556f700 1 Processor -- start 2020-02-12T14:12:33.479 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.476+0000 7f74d556f700 1 -- start start 2020-02-12T14:12:33.481 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.477+0000 7f74d556f700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f74d00a3f40 0x7f74d0134df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:33.481 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.477+0000 7f74d556f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d01359e0 con 0x7f74d0135250 2020-02-12T14:12:33.481 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.477+0000 7f74d556f700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d0135c80 con 0x7f74d00a24a0 2020-02-12T14:12:33.481 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.477+0000 7f74d556f700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d00a18f0 con 0x7f74d00a3f40 2020-02-12T14:12:33.482 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.477+0000 7f74ceffd700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f74d00a3f40 0x7f74d0134df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:33.482 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.477+0000 7f74cf7fe700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f74d00a24a0 0x7f74d012e6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35106/0 (socket says 172.21.15.139:35106) 2020-02-12T14:12:33.482 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.477+0000 7f74cf7fe700 1 -- 172.21.15.139:0/900579361 learned_addr learned my addr 172.21.15.139:0/900579361 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:33.482 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.478+0000 7f74ceffd700 1 -- 172.21.15.139:0/900579361 >> v1:172.21.15.139:6789/0 conn(0x7f74d00a24a0 legacy=0x7f74d012e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:33.482 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.478+0000 7f74ceffd700 1 -- 172.21.15.139:0/900579361 >> v1:172.21.15.72:6789/0 conn(0x7f74d0135250 legacy=0x7f74d00a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:33.483 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.478+0000 7f74ceffd700 1 -- 172.21.15.139:0/900579361 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d01356e0 con 0x7f74d00a3f40 2020-02-12T14:12:33.483 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.478+0000 7f74ceffd700 1 --2- 172.21.15.139:0/900579361 >> v2:172.21.15.139:3300/0 conn(0x7f74d00a3f40 0x7f74d0134df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f74d0060f00 tx=0x7f74c40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.483 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.478+0000 7f74ceffd700 1 --2- 172.21.15.139:0/900579361 >> v2:172.21.15.139:3300/0 conn(0x7f74d00a3f40 0x7f74d0134df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f74d0060f00 tx=0x7f74c40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.483 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.478+0000 7f74ceffd700 1 --2- 172.21.15.139:0/900579361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74d00a3f40 0x7f74d0134df0 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f74d0060f00 tx=0x7f74c40088e0).ready entity=mon.1 client_cookie=c7f815fac0f8e784 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:33.483 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.478+0000 7f74ceffd700 1 --2- 172.21.15.139:0/900579361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74d00a3f40 0x7f74d0134df0 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f74d0060f00 tx=0x7f74c40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.483 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.478+0000 7f74ceffd700 1 --2- 172.21.15.139:0/900579361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74d00a3f40 0x7f74d0134df0 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f74d0060f00 tx=0x7f74c40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.483 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.478+0000 7f74cdffb700 1 -- 172.21.15.139:0/900579361 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74c4008e40 con 0x7f74d00a3f40 2020-02-12T14:12:33.484 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.478+0000 7f74ceffd700 1 --2- 172.21.15.139:0/900579361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74d00a3f40 0x7f74d0134df0 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f74d0060f00 tx=0x7f74c40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.484 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.478+0000 7f74cdffb700 1 -- 172.21.15.139:0/900579361 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c4011660 con 0x7f74d00a3f40 2020-02-12T14:12:33.484 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.478+0000 7f74cdffb700 1 -- 172.21.15.139:0/900579361 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74c4011a40 con 0x7f74d00a3f40 2020-02-12T14:12:33.484 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.478+0000 7f74d556f700 1 -- 172.21.15.139:0/900579361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74d00a3f40 msgr2=0x7f74d0134df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:33.484 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.478+0000 7f74d556f700 1 --2- 172.21.15.139:0/900579361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74d00a3f40 0x7f74d0134df0 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f74d0060f00 tx=0x7f74c40088e0).stop 2020-02-12T14:12:33.484 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.478+0000 7f74d556f700 1 -- 172.21.15.139:0/900579361 shutdown_connections 2020-02-12T14:12:33.484 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.478+0000 7f74d556f700 1 --2- 172.21.15.139:0/900579361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74d00a3f40 0x7f74d0134df0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:33.484 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.478+0000 7f74d556f700 1 -- 172.21.15.139:0/900579361 >> 172.21.15.139:0/900579361 conn(0x7f74d0060950 msgr2=0x7f74d009d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:33.485 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.478+0000 7f74d556f700 1 -- 172.21.15.139:0/900579361 shutdown_connections 2020-02-12T14:12:33.485 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.478+0000 7f74d556f700 1 -- 172.21.15.139:0/900579361 wait complete. 2020-02-12T14:12:33.487 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.479+0000 7f74d556f700 1 Processor -- start 2020-02-12T14:12:33.488 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.479+0000 7f74d556f700 1 -- start start 2020-02-12T14:12:33.488 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.480+0000 7f74d556f700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f74d00a24a0 0x7f74d0148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:33.488 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.480+0000 7f74d556f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74d00a3f40 0x7f74d0148fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:33.488 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.480+0000 7f74d556f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d0130070 con 0x7f74d0135250 2020-02-12T14:12:33.488 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.480+0000 7f74d556f700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d0132570 con 0x7f74d00a24a0 2020-02-12T14:12:33.488 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.480+0000 7f74d556f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d0130c60 con 0x7f74d00a3f40 2020-02-12T14:12:33.488 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.480+0000 7f74ceffd700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f74d00a24a0 0x7f74d0148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:33.489 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.480+0000 7f74ceffd700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f74d00a24a0 0x7f74d0148b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46472/0 (socket says 172.21.15.139:46472) 2020-02-12T14:12:33.489 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.480+0000 7f74ceffd700 1 -- 172.21.15.139:0/3167531555 learned_addr learned my addr 172.21.15.139:0/3167531555 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:33.489 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.480+0000 7f74ceffd700 1 -- 172.21.15.139:0/3167531555 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74d00a3f40 msgr2=0x7f74d0148fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:33.489 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.480+0000 7f74ceffd700 1 --2- 172.21.15.139:0/3167531555 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74d00a3f40 0x7f74d0148fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:33.489 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.480+0000 7f74ceffd700 1 -- 172.21.15.139:0/3167531555 >> v1:172.21.15.72:6789/0 conn(0x7f74d0135250 legacy=0x7f74d012ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:33.489 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.480+0000 7f74ceffd700 1 -- 172.21.15.139:0/3167531555 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d0132810 con 0x7f74d00a24a0 2020-02-12T14:12:33.489 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.480+0000 7f74ceffd700 1 --2- 172.21.15.139:0/3167531555 >> v2:172.21.15.139:3300/0 conn(0x7f74d00a24a0 0x7f74d0148b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f74d0066460 tx=0x7f74d0135870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.489 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.480+0000 7f74ceffd700 1 --2- 172.21.15.139:0/3167531555 >> v2:172.21.15.139:3300/0 conn(0x7f74d00a24a0 0x7f74d0148b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f74d0066460 tx=0x7f74d0135870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.490 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.480+0000 7f74ceffd700 1 --2- 172.21.15.139:0/3167531555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74d00a24a0 0x7f74d0148b80 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f74d0066460 tx=0x7f74d0135870).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:33.490 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.480+0000 7f74ceffd700 1 --2- 172.21.15.139:0/3167531555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74d00a24a0 0x7f74d0148b80 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f74d0066460 tx=0x7f74d0135870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.490 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.480+0000 7f74ceffd700 1 --2- 172.21.15.139:0/3167531555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74d00a24a0 0x7f74d0148b80 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f74d0066460 tx=0x7f74d0135870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.490 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.480+0000 7f74bffff700 1 -- 172.21.15.139:0/3167531555 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74c400f810 con 0x7f74d00a24a0 2020-02-12T14:12:33.490 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.480+0000 7f74ceffd700 1 --2- 172.21.15.139:0/3167531555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74d00a24a0 0x7f74d0148b80 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f74d0066460 tx=0x7f74d0135870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.490 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.480+0000 7f74bffff700 1 -- 172.21.15.139:0/3167531555 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c4011a80 con 0x7f74d00a24a0 2020-02-12T14:12:33.490 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.480+0000 7f74d556f700 1 -- 172.21.15.139:0/3167531555 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d0130f00 con 0x7f74d00a24a0 2020-02-12T14:12:33.490 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.480+0000 7f74bffff700 1 -- 172.21.15.139:0/3167531555 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74c4005aa0 con 0x7f74d00a24a0 2020-02-12T14:12:33.491 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.480+0000 7f74d556f700 1 -- 172.21.15.139:0/3167531555 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d01494c0 con 0x7f74d00a24a0 2020-02-12T14:12:33.491 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.481+0000 7f74ceffd700 1 --2- 172.21.15.139:0/3167531555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74d00a24a0 0x7f74d0148b80 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f74d0066460 tx=0x7f74d0135870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.491 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.481+0000 7f74bffff700 1 -- 172.21.15.139:0/3167531555 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f74c4005d10 con 0x7f74d00a24a0 2020-02-12T14:12:33.491 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.481+0000 7f74ceffd700 1 --2- 172.21.15.139:0/3167531555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74d00a24a0 0x7f74d0148b80 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f74d0066460 tx=0x7f74d0135870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.491 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.481+0000 7f74d556f700 1 -- 172.21.15.139:0/3167531555 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d01308d0 con 0x7f74d00a24a0 2020-02-12T14:12:33.491 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.481+0000 7f74bffff700 1 --2- 172.21.15.139:0/3167531555 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f74ac039d30 0x7f74ac03c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:33.491 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.481+0000 7f74bffff700 1 -- 172.21.15.139:0/3167531555 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f74c404a050 con 0x7f74d00a24a0 2020-02-12T14:12:33.491 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.482+0000 7f74ce7fc700 1 --2- 172.21.15.139:0/3167531555 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f74ac039d30 0x7f74ac03c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:33.492 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.482+0000 7f74ce7fc700 1 --2- 172.21.15.139:0/3167531555 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f74ac039d30 0x7f74ac03c1f0 crc :-1 s=READY pgs=37 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:33.492 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.485+0000 7f74ceffd700 1 --2- 172.21.15.139:0/3167531555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74d00a24a0 0x7f74d0148b80 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f74d0066460 tx=0x7f74d0135870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.492 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.485+0000 7f74bffff700 1 -- 172.21.15.139:0/3167531555 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f74c4032690 con 0x7f74d00a24a0 2020-02-12T14:12:33.622 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.620+0000 7f74d556f700 1 -- 172.21.15.139:0/3167531555 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f74d01308d0 con 0x7f74d00a24a0 2020-02-12T14:12:33.623 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.620+0000 7f74ceffd700 1 --2- 172.21.15.139:0/3167531555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74d00a24a0 0x7f74d0148b80 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f74d0066460 tx=0x7f74d0135870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.623 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.620+0000 7f74bffff700 1 -- 172.21.15.139:0/3167531555 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f74c4032250 con 0x7f74d00a24a0 2020-02-12T14:12:33.623 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 8 2020-02-12T14:12:33.624 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.622+0000 7f74d556f700 1 -- 172.21.15.139:0/3167531555 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f74ac039d30 msgr2=0x7f74ac03c1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:33.625 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.622+0000 7f74d556f700 1 --2- 172.21.15.139:0/3167531555 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f74ac039d30 0x7f74ac03c1f0 crc :-1 s=READY pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:33.625 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.622+0000 7f74d556f700 1 -- 172.21.15.139:0/3167531555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74d00a24a0 msgr2=0x7f74d0148b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:33.625 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.622+0000 7f74d556f700 1 --2- 172.21.15.139:0/3167531555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74d00a24a0 0x7f74d0148b80 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f74d0066460 tx=0x7f74d0135870).stop 2020-02-12T14:12:33.625 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.622+0000 7f74d556f700 1 -- 172.21.15.139:0/3167531555 shutdown_connections 2020-02-12T14:12:33.625 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.622+0000 7f74d556f700 1 --2- 172.21.15.139:0/3167531555 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f74ac039d30 0x7f74ac03c1f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:33.625 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.622+0000 7f74d556f700 1 --2- 172.21.15.139:0/3167531555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74d00a24a0 0x7f74d0148b80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:33.625 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.622+0000 7f74d556f700 1 --2- 172.21.15.139:0/3167531555 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74d00a3f40 0x7f74d0148fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:33.626 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.622+0000 7f74d556f700 1 -- 172.21.15.139:0/3167531555 >> 172.21.15.139:0/3167531555 conn(0x7f74d0060950 msgr2=0x7f74d005e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:33.626 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.622+0000 7f74d556f700 1 -- 172.21.15.139:0/3167531555 shutdown_connections 2020-02-12T14:12:33.626 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.622+0000 7f74d556f700 1 -- 172.21.15.139:0/3167531555 wait complete. 2020-02-12T14:12:33.634 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-02-12T14:12:33.738 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.736+0000 7f11e97d5700 1 Processor -- start 2020-02-12T14:12:33.739 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.736+0000 7f11e97d5700 1 -- start start 2020-02-12T14:12:33.741 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.737+0000 7f11e97d5700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f11e4135500 0x7f11e40a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:33.741 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.737+0000 7f11e97d5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e41359e0 con 0x7f11e40a21f0 2020-02-12T14:12:33.741 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.737+0000 7f11e97d5700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e4135c80 con 0x7f11e40a3f40 2020-02-12T14:12:33.741 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.737+0000 7f11e97d5700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e40a18f0 con 0x7f11e4135500 2020-02-12T14:12:33.742 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.737+0000 7f11e27fc700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f11e4135500 0x7f11e40a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:33.742 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.737+0000 7f11e2ffd700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f11e40a3f40 0x7f11e4134df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35118/0 (socket says 172.21.15.139:35118) 2020-02-12T14:12:33.742 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.737+0000 7f11e2ffd700 1 -- 172.21.15.139:0/667130370 learned_addr learned my addr 172.21.15.139:0/667130370 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:33.742 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.738+0000 7f11e27fc700 1 -- 172.21.15.139:0/667130370 >> v1:172.21.15.139:6789/0 conn(0x7f11e40a3f40 legacy=0x7f11e4134df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:33.742 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.738+0000 7f11e27fc700 1 -- 172.21.15.139:0/667130370 >> v1:172.21.15.72:6789/0 conn(0x7f11e40a21f0 legacy=0x7f11e412e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:33.742 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.738+0000 7f11e27fc700 1 -- 172.21.15.139:0/667130370 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e40a2680 con 0x7f11e4135500 2020-02-12T14:12:33.742 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.738+0000 7f11e27fc700 1 --2- 172.21.15.139:0/667130370 >> v2:172.21.15.139:3300/0 conn(0x7f11e4135500 0x7f11e40a1d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f11d4002f30 tx=0x7f11d40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.742 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.738+0000 7f11e27fc700 1 --2- 172.21.15.139:0/667130370 >> v2:172.21.15.139:3300/0 conn(0x7f11e4135500 0x7f11e40a1d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f11d4002f30 tx=0x7f11d40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.743 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.738+0000 7f11e27fc700 1 --2- 172.21.15.139:0/667130370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11e4135500 0x7f11e40a1d90 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f11d4002f30 tx=0x7f11d40088e0).ready entity=mon.1 client_cookie=3b4a1d06104735d9 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:33.743 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.738+0000 7f11e27fc700 1 --2- 172.21.15.139:0/667130370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11e4135500 0x7f11e40a1d90 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f11d4002f30 tx=0x7f11d40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.743 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.738+0000 7f11e1ffb700 1 -- 172.21.15.139:0/667130370 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11d4008e40 con 0x7f11e4135500 2020-02-12T14:12:33.743 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.738+0000 7f11e27fc700 1 --2- 172.21.15.139:0/667130370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11e4135500 0x7f11e40a1d90 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f11d4002f30 tx=0x7f11d40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.743 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.738+0000 7f11e27fc700 1 --2- 172.21.15.139:0/667130370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11e4135500 0x7f11e40a1d90 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f11d4002f30 tx=0x7f11d40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.743 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.738+0000 7f11e1ffb700 1 -- 172.21.15.139:0/667130370 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d40116a0 con 0x7f11e4135500 2020-02-12T14:12:33.743 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.738+0000 7f11e1ffb700 1 -- 172.21.15.139:0/667130370 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11d4011a80 con 0x7f11e4135500 2020-02-12T14:12:33.744 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.738+0000 7f11e97d5700 1 -- 172.21.15.139:0/667130370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11e4135500 msgr2=0x7f11e40a1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:33.744 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.738+0000 7f11e97d5700 1 --2- 172.21.15.139:0/667130370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11e4135500 0x7f11e40a1d90 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f11d4002f30 tx=0x7f11d40088e0).stop 2020-02-12T14:12:33.744 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.738+0000 7f11e97d5700 1 -- 172.21.15.139:0/667130370 shutdown_connections 2020-02-12T14:12:33.744 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.738+0000 7f11e97d5700 1 --2- 172.21.15.139:0/667130370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11e4135500 0x7f11e40a1d90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:33.744 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.738+0000 7f11e97d5700 1 -- 172.21.15.139:0/667130370 >> 172.21.15.139:0/667130370 conn(0x7f11e4060950 msgr2=0x7f11e409d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:33.744 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.738+0000 7f11e97d5700 1 -- 172.21.15.139:0/667130370 shutdown_connections 2020-02-12T14:12:33.744 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.738+0000 7f11e97d5700 1 -- 172.21.15.139:0/667130370 wait complete. 2020-02-12T14:12:33.747 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.739+0000 7f11e97d5700 1 Processor -- start 2020-02-12T14:12:33.748 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.739+0000 7f11e97d5700 1 -- start start 2020-02-12T14:12:33.748 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.740+0000 7f11e97d5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f11e40a21f0 0x7f11e4146940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:33.748 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.740+0000 7f11e97d5700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f11e40a3f40 0x7f11e409f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:33.748 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.740+0000 7f11e97d5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f11e4135500 0x7f11e40a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:33.748 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.740+0000 7f11e97d5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e409ee10 con 0x7f11e4135500 2020-02-12T14:12:33.748 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.740+0000 7f11e97d5700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e4138880 con 0x7f11e40a3f40 2020-02-12T14:12:33.748 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.740+0000 7f11e97d5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e409f660 con 0x7f11e40a21f0 2020-02-12T14:12:33.749 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.740+0000 7f11e27fc700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f11e40a3f40 0x7f11e409f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:33.749 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.740+0000 7f11e27fc700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f11e40a3f40 0x7f11e409f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46484/0 (socket says 172.21.15.139:46484) 2020-02-12T14:12:33.749 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.740+0000 7f11e27fc700 1 -- 172.21.15.139:0/3465799192 learned_addr learned my addr 172.21.15.139:0/3465799192 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:33.749 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.740+0000 7f11e37fe700 1 --2- 172.21.15.139:0/3465799192 >> v2:172.21.15.72:3300/0 conn(0x7f11e4135500 0x7f11e40a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:33.749 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.740+0000 7f11e2ffd700 1 --2- 172.21.15.139:0/3465799192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f11e40a21f0 0x7f11e4146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:33.749 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.740+0000 7f11e27fc700 1 -- 172.21.15.139:0/3465799192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f11e40a21f0 msgr2=0x7f11e4146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:33.749 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.740+0000 7f11e27fc700 1 --2- 172.21.15.139:0/3465799192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f11e40a21f0 0x7f11e4146940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:33.749 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.740+0000 7f11e27fc700 1 -- 172.21.15.139:0/3465799192 >> v2:172.21.15.72:3300/0 conn(0x7f11e4135500 msgr2=0x7f11e40a0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:33.750 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.740+0000 7f11e27fc700 1 --2- 172.21.15.139:0/3465799192 >> v2:172.21.15.72:3300/0 conn(0x7f11e4135500 0x7f11e40a0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:33.750 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.740+0000 7f11e27fc700 1 -- 172.21.15.139:0/3465799192 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e409e9e0 con 0x7f11e40a3f40 2020-02-12T14:12:33.750 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.740+0000 7f11e37fe700 1 --2- 172.21.15.139:0/3465799192 >> v2:172.21.15.72:3300/0 conn(0x7f11e4135500 0x7f11e40a0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T14:12:33.750 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.740+0000 7f11e2ffd700 1 --2- 172.21.15.139:0/3465799192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f11e40a21f0 0x7f11e4146940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T14:12:33.750 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.740+0000 7f11e27fc700 1 --2- 172.21.15.139:0/3465799192 >> v2:172.21.15.139:3300/0 conn(0x7f11e40a3f40 0x7f11e409f200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f11d4002f30 tx=0x7f11e40a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.750 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.740+0000 7f11e27fc700 1 --2- 172.21.15.139:0/3465799192 >> v2:172.21.15.139:3300/0 conn(0x7f11e40a3f40 0x7f11e409f200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f11d4002f30 tx=0x7f11e40a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.750 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.740+0000 7f11e27fc700 1 --2- 172.21.15.139:0/3465799192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11e40a3f40 0x7f11e409f200 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f11d4002f30 tx=0x7f11e40a2810).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:33.751 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.740+0000 7f11e27fc700 1 --2- 172.21.15.139:0/3465799192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11e40a3f40 0x7f11e409f200 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f11d4002f30 tx=0x7f11e40a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.751 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.740+0000 7f11d3fff700 1 -- 172.21.15.139:0/3465799192 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11d4011b00 con 0x7f11e40a3f40 2020-02-12T14:12:33.751 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.740+0000 7f11e27fc700 1 --2- 172.21.15.139:0/3465799192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11e40a3f40 0x7f11e409f200 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f11d4002f30 tx=0x7f11e40a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.751 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.741+0000 7f11e27fc700 1 --2- 172.21.15.139:0/3465799192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11e40a3f40 0x7f11e409f200 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f11d4002f30 tx=0x7f11e40a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.751 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.741+0000 7f11d3fff700 1 -- 172.21.15.139:0/3465799192 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d400f830 con 0x7f11e40a3f40 2020-02-12T14:12:33.751 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.741+0000 7f11e97d5700 1 -- 172.21.15.139:0/3465799192 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e4137700 con 0x7f11e40a3f40 2020-02-12T14:12:33.752 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.741+0000 7f11d3fff700 1 -- 172.21.15.139:0/3465799192 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11d4007530 con 0x7f11e40a3f40 2020-02-12T14:12:33.752 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.741+0000 7f11e97d5700 1 -- 172.21.15.139:0/3465799192 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e41385e0 con 0x7f11e40a3f40 2020-02-12T14:12:33.752 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.741+0000 7f11e27fc700 1 --2- 172.21.15.139:0/3465799192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11e40a3f40 0x7f11e409f200 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f11d4002f30 tx=0x7f11e40a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.752 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.741+0000 7f11d3fff700 1 -- 172.21.15.139:0/3465799192 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f11d40056c0 con 0x7f11e40a3f40 2020-02-12T14:12:33.752 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.741+0000 7f11e27fc700 1 --2- 172.21.15.139:0/3465799192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11e40a3f40 0x7f11e409f200 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f11d4002f30 tx=0x7f11e40a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.752 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.741+0000 7f11e97d5700 1 -- 172.21.15.139:0/3465799192 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e4137e60 con 0x7f11e40a3f40 2020-02-12T14:12:33.753 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.742+0000 7f11d3fff700 1 --2- 172.21.15.139:0/3465799192 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f11c0039c20 0x7f11c003c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:33.753 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.742+0000 7f11d3fff700 1 -- 172.21.15.139:0/3465799192 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f11d404a190 con 0x7f11e40a3f40 2020-02-12T14:12:33.753 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.742+0000 7f11e2ffd700 1 --2- 172.21.15.139:0/3465799192 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f11c0039c20 0x7f11c003c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:33.753 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.742+0000 7f11e2ffd700 1 --2- 172.21.15.139:0/3465799192 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f11c0039c20 0x7f11c003c0e0 crc :-1 s=READY pgs=38 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:33.753 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.745+0000 7f11e27fc700 1 --2- 172.21.15.139:0/3465799192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11e40a3f40 0x7f11e409f200 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f11d4002f30 tx=0x7f11e40a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.753 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.745+0000 7f11d3fff700 1 -- 172.21.15.139:0/3465799192 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f11d402f8a0 con 0x7f11e40a3f40 2020-02-12T14:12:33.884 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.881+0000 7f11e97d5700 1 -- 172.21.15.139:0/3465799192 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f11e4067e20 con 0x7f11e40a3f40 2020-02-12T14:12:33.884 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.881+0000 7f11e27fc700 1 --2- 172.21.15.139:0/3465799192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11e40a3f40 0x7f11e409f200 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f11d4002f30 tx=0x7f11e40a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:33.884 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.882+0000 7f11d3fff700 1 -- 172.21.15.139:0/3465799192 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+64 (secure 0 0 0) 0x7f11d4032370 con 0x7f11e40a3f40 2020-02-12T14:12:33.885 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:12:33.885 INFO:teuthology.orchestra.run.smithi139.stdout:[ 2020-02-12T14:12:33.885 INFO:teuthology.orchestra.run.smithi139.stdout: { 2020-02-12T14:12:33.885 INFO:teuthology.orchestra.run.smithi139.stdout: "poolnum": 1, 2020-02-12T14:12:33.885 INFO:teuthology.orchestra.run.smithi139.stdout: "poolname": "rbd" 2020-02-12T14:12:33.885 INFO:teuthology.orchestra.run.smithi139.stdout: } 2020-02-12T14:12:33.886 INFO:teuthology.orchestra.run.smithi139.stdout:] 2020-02-12T14:12:33.887 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.883+0000 7f11e97d5700 1 -- 172.21.15.139:0/3465799192 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f11c0039c20 msgr2=0x7f11c003c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:33.887 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.883+0000 7f11e97d5700 1 --2- 172.21.15.139:0/3465799192 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f11c0039c20 0x7f11c003c0e0 crc :-1 s=READY pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:33.887 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.883+0000 7f11e97d5700 1 -- 172.21.15.139:0/3465799192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11e40a3f40 msgr2=0x7f11e409f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:33.887 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.883+0000 7f11e97d5700 1 --2- 172.21.15.139:0/3465799192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11e40a3f40 0x7f11e409f200 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f11d4002f30 tx=0x7f11e40a2810).stop 2020-02-12T14:12:33.888 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.883+0000 7f11e97d5700 1 -- 172.21.15.139:0/3465799192 shutdown_connections 2020-02-12T14:12:33.888 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.883+0000 7f11e97d5700 1 --2- 172.21.15.139:0/3465799192 >> v2:172.21.15.72:3300/0 conn(0x7f11e4135500 0x7f11e40a0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:33.888 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.883+0000 7f11e97d5700 1 --2- 172.21.15.139:0/3465799192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f11e40a21f0 0x7f11e4146940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:33.888 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.883+0000 7f11e97d5700 1 --2- 172.21.15.139:0/3465799192 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f11c0039c20 0x7f11c003c0e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:33.888 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.883+0000 7f11e97d5700 1 --2- 172.21.15.139:0/3465799192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11e40a3f40 0x7f11e409f200 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:33.888 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.883+0000 7f11e97d5700 1 -- 172.21.15.139:0/3465799192 >> 172.21.15.139:0/3465799192 conn(0x7f11e4060950 msgr2=0x7f11e405e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:33.888 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.883+0000 7f11e97d5700 1 -- 172.21.15.139:0/3465799192 shutdown_connections 2020-02-12T14:12:33.889 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:33.883+0000 7f11e97d5700 1 -- 172.21.15.139:0/3465799192 wait complete. 2020-02-12T14:12:33.895 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-02-12T14:12:33.895 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-02-12T14:12:34.002 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.000+0000 7f23ad672700 1 Processor -- start 2020-02-12T14:12:34.003 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.000+0000 7f23ad672700 1 -- start start 2020-02-12T14:12:34.006 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.001+0000 7f23ad672700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f23a805ab20 0x7f23a805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:34.006 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.001+0000 7f23ad672700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a80a4d80 con 0x7f23a80a3de0 2020-02-12T14:12:34.006 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.001+0000 7f23ad672700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a80a4530 con 0x7f23a812fac0 2020-02-12T14:12:34.007 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.001+0000 7f23ad672700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a80a4fe0 con 0x7f23a805ab20 2020-02-12T14:12:34.007 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.001+0000 7f23a77fe700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f23a812fac0 0x7f23a812ff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35128/0 (socket says 172.21.15.139:35128) 2020-02-12T14:12:34.007 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.001+0000 7f23a77fe700 1 -- 172.21.15.139:0/2318482892 learned_addr learned my addr 172.21.15.139:0/2318482892 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:34.007 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.001+0000 7f23a5ffb700 1 -- 172.21.15.139:0/2318482892 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2873411795 0 0) 0x7f23a80a4530 con 0x7f23a812fac0 2020-02-12T14:12:34.007 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.001+0000 7f23a5ffb700 1 -- 172.21.15.139:0/2318482892 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2388003230 con 0x7f23a812fac0 2020-02-12T14:12:34.007 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.001+0000 7f23a67fc700 1 --2- 172.21.15.139:0/2318482892 >> v2:172.21.15.72:3300/0 conn(0x7f23a805ab20 0x7f23a805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:34.008 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a5ffb700 1 -- 172.21.15.139:0/2318482892 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 938285530 0 0) 0x7f2388003230 con 0x7f23a812fac0 2020-02-12T14:12:34.008 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a5ffb700 1 -- 172.21.15.139:0/2318482892 >> v2:172.21.15.72:3300/0 conn(0x7f23a805ab20 msgr2=0x7f23a805afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:34.008 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a5ffb700 1 --2- 172.21.15.139:0/2318482892 >> v2:172.21.15.72:3300/0 conn(0x7f23a805ab20 0x7f23a805afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:34.008 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a5ffb700 1 -- 172.21.15.139:0/2318482892 >> v1:172.21.15.72:6789/0 conn(0x7f23a80a3de0 legacy=0x7f23a809e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:34.008 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a5ffb700 1 -- 172.21.15.139:0/2318482892 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a80a5280 con 0x7f23a812fac0 2020-02-12T14:12:34.008 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a5ffb700 1 -- 172.21.15.139:0/2318482892 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7f23a0001a50 con 0x7f23a812fac0 2020-02-12T14:12:34.008 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a5ffb700 1 -- 172.21.15.139:0/2318482892 >> v1:172.21.15.139:6789/0 conn(0x7f23a812fac0 legacy=0x7f23a812ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:34.008 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a5ffb700 1 --2- 172.21.15.139:0/2318482892 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2388003720 0x7f2388003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:34.009 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a5ffb700 1 --2- 172.21.15.139:0/2318482892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23880044d0 0x7f2388004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:34.009 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a5ffb700 1 --2- 172.21.15.139:0/2318482892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2388004db0 0x7f238800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:34.009 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a5ffb700 1 -- 172.21.15.139:0/2318482892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a80a4fe0 con 0x7f23880044d0 2020-02-12T14:12:34.009 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a5ffb700 1 -- 172.21.15.139:0/2318482892 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23880041c0 con 0x7f2388004db0 2020-02-12T14:12:34.009 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a5ffb700 1 -- 172.21.15.139:0/2318482892 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238800bb80 con 0x7f2388003720 2020-02-12T14:12:34.009 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a67fc700 1 --2- 172.21.15.139:0/2318482892 >> v2:172.21.15.72:3300/0 conn(0x7f23a805ab20 0x7f23a805afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T14:12:34.009 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a77fe700 1 --2- 172.21.15.139:0/2318482892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2388004db0 0x7f238800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:34.010 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a6ffd700 1 --2- 172.21.15.139:0/2318482892 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2388003720 0x7f2388003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:34.010 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a67fc700 1 --2- 172.21.15.139:0/2318482892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23880044d0 0x7f2388004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:34.010 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a77fe700 1 -- 172.21.15.139:0/2318482892 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2388003720 msgr2=0x7f2388003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:34.010 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a77fe700 1 --2- 172.21.15.139:0/2318482892 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2388003720 0x7f2388003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:34.010 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a77fe700 1 -- 172.21.15.139:0/2318482892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23880044d0 msgr2=0x7f2388004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:34.010 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a77fe700 1 --2- 172.21.15.139:0/2318482892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23880044d0 0x7f2388004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:34.010 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a77fe700 1 -- 172.21.15.139:0/2318482892 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2388003230 con 0x7f2388004db0 2020-02-12T14:12:34.011 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a77fe700 1 --2- 172.21.15.139:0/2318482892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2388004db0 0x7f238800b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f23880054a0 tx=0x7f23a80a41c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:34.011 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a77fe700 1 -- 172.21.15.139:0/2318482892 reap_dead start 2020-02-12T14:12:34.011 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a77fe700 1 --2- 172.21.15.139:0/2318482892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2388004db0 0x7f238800b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f23880054a0 tx=0x7f23a80a41c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:34.011 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a77fe700 1 --2- 172.21.15.139:0/2318482892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2388004db0 0x7f238800b720 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f23880054a0 tx=0x7f23a80a41c0).ready entity=mon.1 client_cookie=c3682427c69e02d8 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:34.011 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a77fe700 1 --2- 172.21.15.139:0/2318482892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2388004db0 0x7f238800b720 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f23880054a0 tx=0x7f23a80a41c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:34.011 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a5ffb700 1 -- 172.21.15.139:0/2318482892 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23a000ce80 con 0x7f2388004db0 2020-02-12T14:12:34.011 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a77fe700 1 --2- 172.21.15.139:0/2318482892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2388004db0 0x7f238800b720 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f23880054a0 tx=0x7f23a80a41c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:34.011 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a77fe700 1 --2- 172.21.15.139:0/2318482892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2388004db0 0x7f238800b720 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f23880054a0 tx=0x7f23a80a41c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:34.012 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a5ffb700 1 -- 172.21.15.139:0/2318482892 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a000e5e0 con 0x7f2388004db0 2020-02-12T14:12:34.012 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23a5ffb700 1 -- 172.21.15.139:0/2318482892 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23a000e940 con 0x7f2388004db0 2020-02-12T14:12:34.012 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23ad672700 1 -- 172.21.15.139:0/2318482892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2388004db0 msgr2=0x7f238800b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:34.012 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.002+0000 7f23ad672700 1 --2- 172.21.15.139:0/2318482892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2388004db0 0x7f238800b720 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f23880054a0 tx=0x7f23a80a41c0).stop 2020-02-12T14:12:34.012 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.003+0000 7f23ad672700 1 -- 172.21.15.139:0/2318482892 shutdown_connections 2020-02-12T14:12:34.012 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.003+0000 7f23ad672700 1 --2- 172.21.15.139:0/2318482892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2388004db0 0x7f238800b720 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:34.012 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.003+0000 7f23ad672700 1 -- 172.21.15.139:0/2318482892 >> 172.21.15.139:0/2318482892 conn(0x7f23a8060950 msgr2=0x7f23a809d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:34.013 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.003+0000 7f23ad672700 1 -- 172.21.15.139:0/2318482892 shutdown_connections 2020-02-12T14:12:34.013 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.003+0000 7f23ad672700 1 -- 172.21.15.139:0/2318482892 wait complete. 2020-02-12T14:12:34.013 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.004+0000 7f23ad672700 1 Processor -- start 2020-02-12T14:12:34.013 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.004+0000 7f23ad672700 1 -- start start 2020-02-12T14:12:34.016 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.004+0000 7f23ad672700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f23a81344b0 0x7f23a8139190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:34.016 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.004+0000 7f23ad672700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23a8131a00 0x7f23a81395f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:34.016 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.004+0000 7f23ad672700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a8146870 con 0x7f2388004db0 2020-02-12T14:12:34.016 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.004+0000 7f23ad672700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a80a4220 con 0x7f23a81344b0 2020-02-12T14:12:34.017 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.004+0000 7f23ad672700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a80671d0 con 0x7f23a8131a00 2020-02-12T14:12:34.017 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.004+0000 7f23a6ffd700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f2388004db0 0x7f23a8137450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35140/0 (socket says 172.21.15.139:35140) 2020-02-12T14:12:34.017 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.004+0000 7f23a6ffd700 1 -- 172.21.15.139:0/2934983374 learned_addr learned my addr 172.21.15.139:0/2934983374 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:34.017 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.005+0000 7f23a67fc700 1 --2- 172.21.15.139:0/2934983374 >> v2:172.21.15.72:3300/0 conn(0x7f23a81344b0 0x7f23a8139190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:34.017 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.005+0000 7f23a77fe700 1 --2- 172.21.15.139:0/2934983374 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23a8131a00 0x7f23a81395f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:34.017 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.005+0000 7f239ffff700 1 -- 172.21.15.139:0/2934983374 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184014768 0 0) 0x7f23a8146870 con 0x7f2388004db0 2020-02-12T14:12:34.017 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.005+0000 7f239ffff700 1 -- 172.21.15.139:0/2934983374 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f238c002fe0 con 0x7f2388004db0 2020-02-12T14:12:34.018 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.005+0000 7f23a67fc700 1 -- 172.21.15.139:0/2934983374 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23a8131a00 msgr2=0x7f23a81395f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:34.018 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.005+0000 7f23a67fc700 1 --2- 172.21.15.139:0/2934983374 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23a8131a00 0x7f23a81395f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:34.018 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.005+0000 7f23a67fc700 1 -- 172.21.15.139:0/2934983374 >> v1:172.21.15.139:6789/0 conn(0x7f2388004db0 legacy=0x7f23a8137450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:34.018 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.005+0000 7f23a67fc700 1 -- 172.21.15.139:0/2934983374 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a8134950 con 0x7f23a81344b0 2020-02-12T14:12:34.018 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.005+0000 7f23a67fc700 1 --2- 172.21.15.139:0/2934983374 >> v2:172.21.15.72:3300/0 conn(0x7f23a81344b0 0x7f23a8139190 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2398002f30 tx=0x7f23980109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:34.018 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.005+0000 7f23a67fc700 1 --2- 172.21.15.139:0/2934983374 >> v2:172.21.15.72:3300/0 conn(0x7f23a81344b0 0x7f23a8139190 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2398002f30 tx=0x7f23980109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:34.019 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.005+0000 7f23a67fc700 1 --2- 172.21.15.139:0/2934983374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a81344b0 0x7f23a8139190 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f2398002f30 tx=0x7f23980109c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:34.019 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.005+0000 7f23a67fc700 1 --2- 172.21.15.139:0/2934983374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a81344b0 0x7f23a8139190 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f2398002f30 tx=0x7f23980109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:34.019 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.005+0000 7f239ffff700 1 -- 172.21.15.139:0/2934983374 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2398007540 con 0x7f23a81344b0 2020-02-12T14:12:34.019 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.005+0000 7f23a67fc700 1 --2- 172.21.15.139:0/2934983374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a81344b0 0x7f23a8139190 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f2398002f30 tx=0x7f23980109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:34.019 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.005+0000 7f239ffff700 1 -- 172.21.15.139:0/2934983374 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23980059c0 con 0x7f23a81344b0 2020-02-12T14:12:34.019 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.005+0000 7f23a67fc700 1 --2- 172.21.15.139:0/2934983374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a81344b0 0x7f23a8139190 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f2398002f30 tx=0x7f23980109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:34.019 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.005+0000 7f23ad672700 1 -- 172.21.15.139:0/2934983374 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a8135460 con 0x7f23a81344b0 2020-02-12T14:12:34.020 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.005+0000 7f239ffff700 1 -- 172.21.15.139:0/2934983374 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2398005de0 con 0x7f23a81344b0 2020-02-12T14:12:34.020 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.005+0000 7f23ad672700 1 -- 172.21.15.139:0/2934983374 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a8132200 con 0x7f23a81344b0 2020-02-12T14:12:34.020 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.006+0000 7f23a67fc700 1 --2- 172.21.15.139:0/2934983374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a81344b0 0x7f23a8139190 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f2398002f30 tx=0x7f23980109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:34.020 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.006+0000 7f23ad672700 1 -- 172.21.15.139:0/2934983374 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a81358c0 con 0x7f23a81344b0 2020-02-12T14:12:34.020 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.006+0000 7f239ffff700 1 -- 172.21.15.139:0/2934983374 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f2398009320 con 0x7f23a81344b0 2020-02-12T14:12:34.020 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.006+0000 7f23a67fc700 1 --2- 172.21.15.139:0/2934983374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a81344b0 0x7f23a8139190 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f2398002f30 tx=0x7f23980109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:34.021 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.006+0000 7f239ffff700 1 --2- 172.21.15.139:0/2934983374 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f238c039f10 0x7f238c03c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:34.021 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.006+0000 7f239ffff700 1 -- 172.21.15.139:0/2934983374 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2398049b90 con 0x7f23a81344b0 2020-02-12T14:12:34.021 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.006+0000 7f23a6ffd700 1 --2- 172.21.15.139:0/2934983374 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f238c039f10 0x7f238c03c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:34.021 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.007+0000 7f23a6ffd700 1 --2- 172.21.15.139:0/2934983374 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f238c039f10 0x7f238c03c3d0 crc :-1 s=READY pgs=39 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:34.021 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.010+0000 7f23a67fc700 1 --2- 172.21.15.139:0/2934983374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a81344b0 0x7f23a8139190 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f2398002f30 tx=0x7f23980109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:34.021 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.010+0000 7f239ffff700 1 -- 172.21.15.139:0/2934983374 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f239802f1e0 con 0x7f23a81344b0 2020-02-12T14:12:34.148 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:34.146+0000 7f23ad672700 1 -- 172.21.15.139:0/2934983374 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f23a8067e20 con 0x7f23a81344b0 2020-02-12T14:12:35.104 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.101+0000 7f23a67fc700 1 --2- 172.21.15.139:0/2934983374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a81344b0 0x7f23a8139190 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f2398002f30 tx=0x7f23980109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:35.104 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.101+0000 7f239ffff700 1 -- 172.21.15.139:0/2934983374 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v18) v1 ==== 133+0+0 (secure 0 0 0) 0x7f2398031cb0 con 0x7f23a81344b0 2020-02-12T14:12:35.106 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.103+0000 7f23ad672700 1 -- 172.21.15.139:0/2934983374 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f238c039f10 msgr2=0x7f238c03c3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:35.106 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.103+0000 7f23ad672700 1 --2- 172.21.15.139:0/2934983374 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f238c039f10 0x7f238c03c3d0 crc :-1 s=READY pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:35.106 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.103+0000 7f23ad672700 1 -- 172.21.15.139:0/2934983374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a81344b0 msgr2=0x7f23a8139190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:35.107 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.103+0000 7f23ad672700 1 --2- 172.21.15.139:0/2934983374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a81344b0 0x7f23a8139190 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f2398002f30 tx=0x7f23980109c0).stop 2020-02-12T14:12:35.107 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.103+0000 7f23ad672700 1 -- 172.21.15.139:0/2934983374 shutdown_connections 2020-02-12T14:12:35.107 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.103+0000 7f23ad672700 1 --2- 172.21.15.139:0/2934983374 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f238c039f10 0x7f238c03c3d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:35.107 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.103+0000 7f23ad672700 1 --2- 172.21.15.139:0/2934983374 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23a8131a00 0x7f23a81395f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:35.107 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.103+0000 7f23ad672700 1 --2- 172.21.15.139:0/2934983374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a81344b0 0x7f23a8139190 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:35.107 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.103+0000 7f23ad672700 1 -- 172.21.15.139:0/2934983374 >> 172.21.15.139:0/2934983374 conn(0x7f23a8060950 msgr2=0x7f23a812fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:35.107 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.104+0000 7f23ad672700 1 -- 172.21.15.139:0/2934983374 shutdown_connections 2020-02-12T14:12:35.108 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.104+0000 7f23ad672700 1 -- 172.21.15.139:0/2934983374 wait complete. 2020-02-12T14:12:35.108 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'cephfs_metadata' created 2020-02-12T14:12:35.118 INFO:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2020-02-12T14:12:35.118 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd erasure-code-profile set cephfs_data m=2 k=2 crush-failure-domain=osd 2020-02-12T14:12:35.234 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.232+0000 7f7be7e4b700 1 Processor -- start 2020-02-12T14:12:35.234 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.232+0000 7f7be7e4b700 1 -- start start 2020-02-12T14:12:35.240 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.233+0000 7f7be7e4b700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7be00a3f40 0x7f7be0134df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:35.240 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.233+0000 7f7be7e4b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7be0135250 0x7f7be00a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:35.240 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.233+0000 7f7be7e4b700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be01359e0 con 0x7f7be00a21f0 2020-02-12T14:12:35.240 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.233+0000 7f7be7e4b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be0135c80 con 0x7f7be0135250 2020-02-12T14:12:35.241 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.233+0000 7f7be63e8700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f7be00a21f0 0x7f7be0138340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35146/0 (socket says 172.21.15.139:35146) 2020-02-12T14:12:35.241 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.233+0000 7f7be63e8700 1 -- 172.21.15.139:0/4131724613 learned_addr learned my addr 172.21.15.139:0/4131724613 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:35.241 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.233+0000 7f7be7e4b700 1 -- 172.21.15.139:0/4131724613 --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be00a18f0 con 0x7f7be00a3f40 2020-02-12T14:12:35.241 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.233+0000 7f7be5be7700 1 --2- 172.21.15.139:0/4131724613 >> v2:172.21.15.139:3300/0 conn(0x7f7be00a3f40 0x7f7be0134df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:35.241 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.233+0000 7f7be53e6700 1 --2- 172.21.15.139:0/4131724613 >> v2:172.21.15.72:3300/0 conn(0x7f7be0135250 0x7f7be00a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:35.241 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.233+0000 7f7be4be5700 1 -- 172.21.15.139:0/4131724613 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 470915580 0 0) 0x7f7be01359e0 con 0x7f7be00a21f0 2020-02-12T14:12:35.241 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.233+0000 7f7be4be5700 1 -- 172.21.15.139:0/4131724613 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bc8003230 con 0x7f7be00a21f0 2020-02-12T14:12:35.242 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.233+0000 7f7be5be7700 1 -- 172.21.15.139:0/4131724613 >> v2:172.21.15.72:3300/0 conn(0x7f7be0135250 msgr2=0x7f7be00a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:35.242 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.233+0000 7f7be5be7700 1 --2- 172.21.15.139:0/4131724613 >> v2:172.21.15.72:3300/0 conn(0x7f7be0135250 0x7f7be00a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:35.242 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.233+0000 7f7be5be7700 1 -- 172.21.15.139:0/4131724613 >> v1:172.21.15.139:6789/0 conn(0x7f7be00a21f0 legacy=0x7f7be0138340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:35.242 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.233+0000 7f7be5be7700 1 -- 172.21.15.139:0/4131724613 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be01356e0 con 0x7f7be00a3f40 2020-02-12T14:12:35.242 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.233+0000 7f7be5be7700 1 --2- 172.21.15.139:0/4131724613 >> v2:172.21.15.139:3300/0 conn(0x7f7be00a3f40 0x7f7be0134df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7bd0002f30 tx=0x7f7bd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:35.242 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.233+0000 7f7be5be7700 1 --2- 172.21.15.139:0/4131724613 >> v2:172.21.15.139:3300/0 conn(0x7f7be00a3f40 0x7f7be0134df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7bd0002f30 tx=0x7f7bd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:35.242 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.233+0000 7f7be5be7700 1 --2- 172.21.15.139:0/4131724613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7be00a3f40 0x7f7be0134df0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f7bd0002f30 tx=0x7f7bd0007a40).ready entity=mon.1 client_cookie=ee19011b9ecea79 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:35.243 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.233+0000 7f7be5be7700 1 --2- 172.21.15.139:0/4131724613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7be00a3f40 0x7f7be0134df0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f7bd0002f30 tx=0x7f7bd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:35.243 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.233+0000 7f7be4be5700 1 -- 172.21.15.139:0/4131724613 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bd0011310 con 0x7f7be00a3f40 2020-02-12T14:12:35.243 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.233+0000 7f7be5be7700 1 --2- 172.21.15.139:0/4131724613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7be00a3f40 0x7f7be0134df0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f7bd0002f30 tx=0x7f7bd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:35.243 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.234+0000 7f7be4be5700 1 -- 172.21.15.139:0/4131724613 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd0011470 con 0x7f7be00a3f40 2020-02-12T14:12:35.243 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.234+0000 7f7be5be7700 1 --2- 172.21.15.139:0/4131724613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7be00a3f40 0x7f7be0134df0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f7bd0002f30 tx=0x7f7bd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:35.243 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.234+0000 7f7be7e4b700 1 -- 172.21.15.139:0/4131724613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7be00a3f40 msgr2=0x7f7be0134df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:35.244 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.234+0000 7f7be4be5700 1 -- 172.21.15.139:0/4131724613 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bd0011810 con 0x7f7be00a3f40 2020-02-12T14:12:35.244 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.234+0000 7f7be7e4b700 1 --2- 172.21.15.139:0/4131724613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7be00a3f40 0x7f7be0134df0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f7bd0002f30 tx=0x7f7bd0007a40).stop 2020-02-12T14:12:35.244 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.234+0000 7f7be7e4b700 1 -- 172.21.15.139:0/4131724613 shutdown_connections 2020-02-12T14:12:35.244 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.234+0000 7f7be7e4b700 1 --2- 172.21.15.139:0/4131724613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7be00a3f40 0x7f7be0134df0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:35.244 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.234+0000 7f7be7e4b700 1 --2- 172.21.15.139:0/4131724613 >> v2:172.21.15.72:3300/0 conn(0x7f7be0135250 0x7f7be00a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:35.244 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.234+0000 7f7be7e4b700 1 -- 172.21.15.139:0/4131724613 >> 172.21.15.139:0/4131724613 conn(0x7f7be0060950 msgr2=0x7f7be009d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:35.244 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.234+0000 7f7be7e4b700 1 -- 172.21.15.139:0/4131724613 shutdown_connections 2020-02-12T14:12:35.244 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.234+0000 7f7be7e4b700 1 -- 172.21.15.139:0/4131724613 wait complete. 2020-02-12T14:12:35.245 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.235+0000 7f7be7e4b700 1 Processor -- start 2020-02-12T14:12:35.245 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.235+0000 7f7be7e4b700 1 -- start start 2020-02-12T14:12:35.245 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.236+0000 7f7be7e4b700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7be00a21f0 0x7f7be0135f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:35.245 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.236+0000 7f7be7e4b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7be00a3f40 0x7f7be0145fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:35.245 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.236+0000 7f7be7e4b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be0065370 con 0x7f7be0135250 2020-02-12T14:12:35.245 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.236+0000 7f7be7e4b700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be01366e0 con 0x7f7be00a21f0 2020-02-12T14:12:35.245 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.236+0000 7f7be7e4b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be0145860 con 0x7f7be00a3f40 2020-02-12T14:12:35.246 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.236+0000 7f7be5be7700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7be00a21f0 0x7f7be0135f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:35.246 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.236+0000 7f7be5be7700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7be00a21f0 0x7f7be0135f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46514/0 (socket says 172.21.15.139:46514) 2020-02-12T14:12:35.246 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.236+0000 7f7be5be7700 1 -- 172.21.15.139:0/344022597 learned_addr learned my addr 172.21.15.139:0/344022597 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:35.246 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.236+0000 7f7be53e6700 1 --2- 172.21.15.139:0/344022597 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7be00a3f40 0x7f7be0145fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:35.246 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.236+0000 7f7be5be7700 1 -- 172.21.15.139:0/344022597 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7be00a3f40 msgr2=0x7f7be0145fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:35.246 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.236+0000 7f7be5be7700 1 --2- 172.21.15.139:0/344022597 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7be00a3f40 0x7f7be0145fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:35.247 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.236+0000 7f7be5be7700 1 -- 172.21.15.139:0/344022597 >> v1:172.21.15.72:6789/0 conn(0x7f7be0135250 legacy=0x7f7be0148db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:35.247 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.236+0000 7f7be5be7700 1 -- 172.21.15.139:0/344022597 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be0145b00 con 0x7f7be00a21f0 2020-02-12T14:12:35.247 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.236+0000 7f7be5be7700 1 --2- 172.21.15.139:0/344022597 >> v2:172.21.15.139:3300/0 conn(0x7f7be00a21f0 0x7f7be0135f60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7bd0002f30 tx=0x7f7bd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:35.247 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.236+0000 7f7be5be7700 1 --2- 172.21.15.139:0/344022597 >> v2:172.21.15.139:3300/0 conn(0x7f7be00a21f0 0x7f7be0135f60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7bd0002f30 tx=0x7f7bd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:35.247 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.236+0000 7f7be5be7700 1 --2- 172.21.15.139:0/344022597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7be00a21f0 0x7f7be0135f60 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f7bd0002f30 tx=0x7f7bd0007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:35.247 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.236+0000 7f7be5be7700 1 --2- 172.21.15.139:0/344022597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7be00a21f0 0x7f7be0135f60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f7bd0002f30 tx=0x7f7bd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:35.247 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.236+0000 7f7bceffd700 1 -- 172.21.15.139:0/344022597 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bd0007150 con 0x7f7be00a21f0 2020-02-12T14:12:35.248 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.236+0000 7f7be5be7700 1 --2- 172.21.15.139:0/344022597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7be00a21f0 0x7f7be0135f60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f7bd0002f30 tx=0x7f7bd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:35.248 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.236+0000 7f7be5be7700 1 --2- 172.21.15.139:0/344022597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7be00a21f0 0x7f7be0135f60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f7bd0002f30 tx=0x7f7bd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:35.248 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.236+0000 7f7bceffd700 1 -- 172.21.15.139:0/344022597 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd00072b0 con 0x7f7be00a21f0 2020-02-12T14:12:35.248 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.236+0000 7f7be7e4b700 1 -- 172.21.15.139:0/344022597 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be01363c0 con 0x7f7be00a21f0 2020-02-12T14:12:35.248 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.236+0000 7f7bceffd700 1 -- 172.21.15.139:0/344022597 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bd00056c0 con 0x7f7be00a21f0 2020-02-12T14:12:35.248 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.236+0000 7f7be7e4b700 1 -- 172.21.15.139:0/344022597 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be005aaa0 con 0x7f7be00a21f0 2020-02-12T14:12:35.248 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.237+0000 7f7be5be7700 1 --2- 172.21.15.139:0/344022597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7be00a21f0 0x7f7be0135f60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f7bd0002f30 tx=0x7f7bd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:35.248 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.237+0000 7f7bceffd700 1 -- 172.21.15.139:0/344022597 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f7bd0005930 con 0x7f7be00a21f0 2020-02-12T14:12:35.249 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.237+0000 7f7be5be7700 1 --2- 172.21.15.139:0/344022597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7be00a21f0 0x7f7be0135f60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f7bd0002f30 tx=0x7f7bd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:35.249 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.237+0000 7f7bceffd700 1 --2- 172.21.15.139:0/344022597 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f7bc0039c80 0x7f7bc003c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:35.249 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.238+0000 7f7bceffd700 1 -- 172.21.15.139:0/344022597 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5207+0+0 (secure 0 0 0) 0x7f7bd004a7c0 con 0x7f7be00a21f0 2020-02-12T14:12:35.249 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.238+0000 7f7be7e4b700 1 -- 172.21.15.139:0/344022597 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be0067e20 con 0x7f7be00a21f0 2020-02-12T14:12:35.249 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.238+0000 7f7be53e6700 1 --2- 172.21.15.139:0/344022597 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f7bc0039c80 0x7f7bc003c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:35.249 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.238+0000 7f7be53e6700 1 --2- 172.21.15.139:0/344022597 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f7bc0039c80 0x7f7bc003c140 crc :-1 s=READY pgs=40 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:35.250 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.241+0000 7f7be5be7700 1 --2- 172.21.15.139:0/344022597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7be00a21f0 0x7f7be0135f60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f7bd0002f30 tx=0x7f7bd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:35.250 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.241+0000 7f7bceffd700 1 -- 172.21.15.139:0/344022597 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f7bd002ff30 con 0x7f7be00a21f0 2020-02-12T14:12:35.393 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:35.391+0000 7f7be7e4b700 1 -- 172.21.15.139:0/344022597 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f7be012f3f0 con 0x7f7be00a21f0 2020-02-12T14:12:36.106 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.104+0000 7f7be5be7700 1 --2- 172.21.15.139:0/344022597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7be00a21f0 0x7f7be0135f60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f7bd0002f30 tx=0x7f7bd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:36.106 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.104+0000 7f7bceffd700 1 -- 172.21.15.139:0/344022597 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v19) v1 ==== 154+0+0 (secure 0 0 0) 0x7f7bd00329e0 con 0x7f7be00a21f0 2020-02-12T14:12:36.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.107+0000 7f7be7e4b700 1 -- 172.21.15.139:0/344022597 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f7bc0039c80 msgr2=0x7f7bc003c140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:36.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.107+0000 7f7be7e4b700 1 --2- 172.21.15.139:0/344022597 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f7bc0039c80 0x7f7bc003c140 crc :-1 s=READY pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:36.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.107+0000 7f7be7e4b700 1 -- 172.21.15.139:0/344022597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7be00a21f0 msgr2=0x7f7be0135f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:36.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.107+0000 7f7be7e4b700 1 --2- 172.21.15.139:0/344022597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7be00a21f0 0x7f7be0135f60 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f7bd0002f30 tx=0x7f7bd0007a40).stop 2020-02-12T14:12:36.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.107+0000 7f7be7e4b700 1 -- 172.21.15.139:0/344022597 shutdown_connections 2020-02-12T14:12:36.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.107+0000 7f7be7e4b700 1 --2- 172.21.15.139:0/344022597 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f7bc0039c80 0x7f7bc003c140 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:36.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.107+0000 7f7be7e4b700 1 --2- 172.21.15.139:0/344022597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7be00a21f0 0x7f7be0135f60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:36.111 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.107+0000 7f7be7e4b700 1 --2- 172.21.15.139:0/344022597 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7be00a3f40 0x7f7be0145fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:36.111 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.107+0000 7f7be7e4b700 1 -- 172.21.15.139:0/344022597 >> 172.21.15.139:0/344022597 conn(0x7f7be0060950 msgr2=0x7f7be00a6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:36.111 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.107+0000 7f7be7e4b700 1 -- 172.21.15.139:0/344022597 shutdown_connections 2020-02-12T14:12:36.111 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.107+0000 7f7be7e4b700 1 -- 172.21.15.139:0/344022597 wait complete. 2020-02-12T14:12:36.122 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 erasure cephfs_data 2020-02-12T14:12:36.235 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.233+0000 7f3e17b8c700 1 Processor -- start 2020-02-12T14:12:36.235 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.233+0000 7f3e17b8c700 1 -- start start 2020-02-12T14:12:36.238 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.234+0000 7f3e17b8c700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3e10135500 0x7f3e100a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:36.238 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.234+0000 7f3e17b8c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e101359e0 con 0x7f3e100a3f40 2020-02-12T14:12:36.238 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.234+0000 7f3e17b8c700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e10135c80 con 0x7f3e100a21f0 2020-02-12T14:12:36.238 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.234+0000 7f3e17b8c700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e100a18f0 con 0x7f3e10135500 2020-02-12T14:12:36.238 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.234+0000 7f3e15127700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3e10135500 0x7f3e100a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:36.239 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.234+0000 7f3e16129700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f3e100a21f0 0x7f3e1012e6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35164/0 (socket says 172.21.15.139:35164) 2020-02-12T14:12:36.239 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.234+0000 7f3e16129700 1 -- 172.21.15.139:0/2898146481 learned_addr learned my addr 172.21.15.139:0/2898146481 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:36.239 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.234+0000 7f3e15127700 1 -- 172.21.15.139:0/2898146481 >> v1:172.21.15.139:6789/0 conn(0x7f3e100a21f0 legacy=0x7f3e1012e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:36.239 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.234+0000 7f3e15127700 1 -- 172.21.15.139:0/2898146481 >> v1:172.21.15.72:6789/0 conn(0x7f3e100a3f40 legacy=0x7f3e10134df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:36.239 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.234+0000 7f3e14926700 1 -- 172.21.15.139:0/2898146481 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2583547221 0 0) 0x7f3e10135c80 con 0x7f3e100a21f0 2020-02-12T14:12:36.239 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.234+0000 7f3e15127700 1 -- 172.21.15.139:0/2898146481 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e100a2680 con 0x7f3e10135500 2020-02-12T14:12:36.239 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.234+0000 7f3e15127700 1 --2- 172.21.15.139:0/2898146481 >> v2:172.21.15.139:3300/0 conn(0x7f3e10135500 0x7f3e100a1d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3e0c002f30 tx=0x7f3e0c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:36.240 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.234+0000 7f3e15127700 1 --2- 172.21.15.139:0/2898146481 >> v2:172.21.15.139:3300/0 conn(0x7f3e10135500 0x7f3e100a1d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3e0c002f30 tx=0x7f3e0c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:36.240 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.234+0000 7f3e15127700 1 --2- 172.21.15.139:0/2898146481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e10135500 0x7f3e100a1d90 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f3e0c002f30 tx=0x7f3e0c0088e0).ready entity=mon.1 client_cookie=d19bf59de5c8412b server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:36.240 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.234+0000 7f3e15127700 1 --2- 172.21.15.139:0/2898146481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e10135500 0x7f3e100a1d90 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f3e0c002f30 tx=0x7f3e0c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:36.240 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.234+0000 7f3e14926700 1 -- 172.21.15.139:0/2898146481 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e0c008e40 con 0x7f3e10135500 2020-02-12T14:12:36.240 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.234+0000 7f3e15127700 1 --2- 172.21.15.139:0/2898146481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e10135500 0x7f3e100a1d90 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f3e0c002f30 tx=0x7f3e0c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:36.240 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.234+0000 7f3e14926700 1 -- 172.21.15.139:0/2898146481 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c0116a0 con 0x7f3e10135500 2020-02-12T14:12:36.240 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.234+0000 7f3e15127700 1 --2- 172.21.15.139:0/2898146481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e10135500 0x7f3e100a1d90 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f3e0c002f30 tx=0x7f3e0c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:36.241 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.234+0000 7f3e14926700 1 -- 172.21.15.139:0/2898146481 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e0c011a80 con 0x7f3e10135500 2020-02-12T14:12:36.241 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.234+0000 7f3e17b8c700 1 -- 172.21.15.139:0/2898146481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e10135500 msgr2=0x7f3e100a1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:36.241 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.234+0000 7f3e17b8c700 1 --2- 172.21.15.139:0/2898146481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e10135500 0x7f3e100a1d90 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f3e0c002f30 tx=0x7f3e0c0088e0).stop 2020-02-12T14:12:36.241 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.235+0000 7f3e17b8c700 1 -- 172.21.15.139:0/2898146481 shutdown_connections 2020-02-12T14:12:36.241 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.235+0000 7f3e17b8c700 1 --2- 172.21.15.139:0/2898146481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e10135500 0x7f3e100a1d90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:36.241 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.235+0000 7f3e17b8c700 1 -- 172.21.15.139:0/2898146481 >> 172.21.15.139:0/2898146481 conn(0x7f3e10060950 msgr2=0x7f3e1009d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:36.241 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.235+0000 7f3e17b8c700 1 -- 172.21.15.139:0/2898146481 shutdown_connections 2020-02-12T14:12:36.241 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.235+0000 7f3e17b8c700 1 -- 172.21.15.139:0/2898146481 wait complete. 2020-02-12T14:12:36.242 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.236+0000 7f3e17b8c700 1 Processor -- start 2020-02-12T14:12:36.242 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.236+0000 7f3e17b8c700 1 -- start start 2020-02-12T14:12:36.245 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.236+0000 7f3e17b8c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3e100a21f0 0x7f3e1009e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:36.245 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.236+0000 7f3e17b8c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e100a3f40 0x7f3e100a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:36.245 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.236+0000 7f3e17b8c700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3e10135500 0x7f3e1012af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:36.245 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.236+0000 7f3e17b8c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e101373d0 con 0x7f3e100a21f0 2020-02-12T14:12:36.245 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.236+0000 7f3e17b8c700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e1012bbc0 con 0x7f3e10135500 2020-02-12T14:12:36.246 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.236+0000 7f3e17b8c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e10136e90 con 0x7f3e100a3f40 2020-02-12T14:12:36.246 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.237+0000 7f3e16129700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3e10135500 0x7f3e1012af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:36.246 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.237+0000 7f3e16129700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3e10135500 0x7f3e1012af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46532/0 (socket says 172.21.15.139:46532) 2020-02-12T14:12:36.246 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.237+0000 7f3e16129700 1 -- 172.21.15.139:0/2743605310 learned_addr learned my addr 172.21.15.139:0/2743605310 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:36.246 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.237+0000 7f3e15127700 1 --2- 172.21.15.139:0/2743605310 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e100a3f40 0x7f3e100a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:36.246 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.237+0000 7f3e15928700 1 --2- 172.21.15.139:0/2743605310 >> v2:172.21.15.72:3300/0 conn(0x7f3e100a21f0 0x7f3e1009e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:36.246 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.237+0000 7f3e16129700 1 -- 172.21.15.139:0/2743605310 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e100a3f40 msgr2=0x7f3e100a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:36.247 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.237+0000 7f3e16129700 1 --2- 172.21.15.139:0/2743605310 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e100a3f40 0x7f3e100a0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:36.247 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.237+0000 7f3e16129700 1 -- 172.21.15.139:0/2743605310 >> v2:172.21.15.72:3300/0 conn(0x7f3e100a21f0 msgr2=0x7f3e1009e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:36.247 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.237+0000 7f3e16129700 1 --2- 172.21.15.139:0/2743605310 >> v2:172.21.15.72:3300/0 conn(0x7f3e100a21f0 0x7f3e1009e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:36.247 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.237+0000 7f3e16129700 1 -- 172.21.15.139:0/2743605310 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e10137130 con 0x7f3e10135500 2020-02-12T14:12:36.247 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.237+0000 7f3e16129700 1 --2- 172.21.15.139:0/2743605310 >> v2:172.21.15.139:3300/0 conn(0x7f3e10135500 0x7f3e1012af10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3e08000f00 tx=0x7f3e08010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:36.247 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.237+0000 7f3e16129700 1 --2- 172.21.15.139:0/2743605310 >> v2:172.21.15.139:3300/0 conn(0x7f3e10135500 0x7f3e1012af10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3e08000f00 tx=0x7f3e08010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:36.247 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.237+0000 7f3e16129700 1 --2- 172.21.15.139:0/2743605310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e10135500 0x7f3e1012af10 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f3e08000f00 tx=0x7f3e08010cc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:36.248 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.237+0000 7f3e16129700 1 --2- 172.21.15.139:0/2743605310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e10135500 0x7f3e1012af10 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f3e08000f00 tx=0x7f3e08010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:36.248 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.237+0000 7f3dfeffd700 1 -- 172.21.15.139:0/2743605310 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e08005e30 con 0x7f3e10135500 2020-02-12T14:12:36.248 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.237+0000 7f3e16129700 1 --2- 172.21.15.139:0/2743605310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e10135500 0x7f3e1012af10 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f3e08000f00 tx=0x7f3e08010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:36.248 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.237+0000 7f3e16129700 1 --2- 172.21.15.139:0/2743605310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e10135500 0x7f3e1012af10 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f3e08000f00 tx=0x7f3e08010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:36.248 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.237+0000 7f3dfeffd700 1 -- 172.21.15.139:0/2743605310 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e080124a0 con 0x7f3e10135500 2020-02-12T14:12:36.248 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.237+0000 7f3e17b8c700 1 -- 172.21.15.139:0/2743605310 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e10136850 con 0x7f3e10135500 2020-02-12T14:12:36.248 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.237+0000 7f3dfeffd700 1 -- 172.21.15.139:0/2743605310 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e080128c0 con 0x7f3e10135500 2020-02-12T14:12:36.249 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.237+0000 7f3e17b8c700 1 -- 172.21.15.139:0/2743605310 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e1009fcb0 con 0x7f3e10135500 2020-02-12T14:12:36.249 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.238+0000 7f3e16129700 1 --2- 172.21.15.139:0/2743605310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e10135500 0x7f3e1012af10 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f3e08000f00 tx=0x7f3e08010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:36.249 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.238+0000 7f3dfeffd700 1 -- 172.21.15.139:0/2743605310 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f3e08012b80 con 0x7f3e10135500 2020-02-12T14:12:36.249 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.238+0000 7f3e16129700 1 --2- 172.21.15.139:0/2743605310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e10135500 0x7f3e1012af10 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f3e08000f00 tx=0x7f3e08010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:36.249 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.238+0000 7f3dfeffd700 1 --2- 172.21.15.139:0/2743605310 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f3df0039c90 0x7f3df003c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:36.249 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.238+0000 7f3dfeffd700 1 -- 172.21.15.139:0/2743605310 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5463+0+0 (secure 0 0 0) 0x7f3e08049ee0 con 0x7f3e10135500 2020-02-12T14:12:36.249 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.238+0000 7f3e17b8c700 1 -- 172.21.15.139:0/2743605310 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e10136cd0 con 0x7f3e10135500 2020-02-12T14:12:36.250 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.238+0000 7f3e15928700 1 --2- 172.21.15.139:0/2743605310 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f3df0039c90 0x7f3df003c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:36.250 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.238+0000 7f3e15928700 1 --2- 172.21.15.139:0/2743605310 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f3df0039c90 0x7f3df003c150 crc :-1 s=READY pgs=41 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:36.250 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.242+0000 7f3e16129700 1 --2- 172.21.15.139:0/2743605310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e10135500 0x7f3e1012af10 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f3e08000f00 tx=0x7f3e08010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:36.250 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.242+0000 7f3dfeffd700 1 -- 172.21.15.139:0/2743605310 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f3e0802f550 con 0x7f3e10135500 2020-02-12T14:12:36.381 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:36.379+0000 7f3e17b8c700 1 -- 172.21.15.139:0/2743605310 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"} v 0) v1 -- 0x7f3e10067e20 con 0x7f3e10135500 2020-02-12T14:12:38.123 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.121+0000 7f3e16129700 1 --2- 172.21.15.139:0/2743605310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e10135500 0x7f3e1012af10 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f3e08000f00 tx=0x7f3e08010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:38.123 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.121+0000 7f3dfeffd700 1 -- 172.21.15.139:0/2743605310 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"}]=0 pool 'cephfs_data' created v21) v1 ==== 188+0+0 (secure 0 0 0) 0x7f3e08032060 con 0x7f3e10135500 2020-02-12T14:12:38.126 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.124+0000 7f3e17b8c700 1 -- 172.21.15.139:0/2743605310 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f3df0039c90 msgr2=0x7f3df003c150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:38.127 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.124+0000 7f3e17b8c700 1 --2- 172.21.15.139:0/2743605310 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f3df0039c90 0x7f3df003c150 crc :-1 s=READY pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:38.127 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.124+0000 7f3e17b8c700 1 -- 172.21.15.139:0/2743605310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e10135500 msgr2=0x7f3e1012af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:38.127 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.124+0000 7f3e17b8c700 1 --2- 172.21.15.139:0/2743605310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e10135500 0x7f3e1012af10 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f3e08000f00 tx=0x7f3e08010cc0).stop 2020-02-12T14:12:38.127 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.124+0000 7f3e17b8c700 1 -- 172.21.15.139:0/2743605310 shutdown_connections 2020-02-12T14:12:38.127 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.124+0000 7f3e17b8c700 1 --2- 172.21.15.139:0/2743605310 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f3df0039c90 0x7f3df003c150 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:38.127 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.124+0000 7f3e17b8c700 1 --2- 172.21.15.139:0/2743605310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e10135500 0x7f3e1012af10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:38.128 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.124+0000 7f3e17b8c700 1 --2- 172.21.15.139:0/2743605310 >> v2:172.21.15.72:3300/0 conn(0x7f3e100a21f0 0x7f3e1009e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:38.128 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.124+0000 7f3e17b8c700 1 --2- 172.21.15.139:0/2743605310 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e100a3f40 0x7f3e100a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:38.128 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.124+0000 7f3e17b8c700 1 -- 172.21.15.139:0/2743605310 >> 172.21.15.139:0/2743605310 conn(0x7f3e10060950 msgr2=0x7f3e1005e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:38.128 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.124+0000 7f3e17b8c700 1 -- 172.21.15.139:0/2743605310 shutdown_connections 2020-02-12T14:12:38.128 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.124+0000 7f3e17b8c700 1 -- 172.21.15.139:0/2743605310 wait complete. 2020-02-12T14:12:38.129 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'cephfs_data' created 2020-02-12T14:12:38.138 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool set cephfs_data allow_ec_overwrites true 2020-02-12T14:12:38.252 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.250+0000 7f2199e3d700 1 Processor -- start 2020-02-12T14:12:38.252 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.250+0000 7f2199e3d700 1 -- start start 2020-02-12T14:12:38.259 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.250+0000 7f2199e3d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21940a3f40 0x7f2194134df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:38.259 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.250+0000 7f2199e3d700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2194135250 0x7f21940a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:38.259 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.250+0000 7f2199e3d700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21941359e0 con 0x7f21940a21f0 2020-02-12T14:12:38.260 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.250+0000 7f2199e3d700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2194135c80 con 0x7f2194135250 2020-02-12T14:12:38.260 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.250+0000 7f2199e3d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21940a18f0 con 0x7f21940a3f40 2020-02-12T14:12:38.260 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.250+0000 7f2192ffd700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2194135250 0x7f21940a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:38.260 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.250+0000 7f2193fff700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f21940a21f0 0x7f2194138340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35174/0 (socket says 172.21.15.139:35174) 2020-02-12T14:12:38.260 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.250+0000 7f2193fff700 1 -- 172.21.15.139:0/3022950262 learned_addr learned my addr 172.21.15.139:0/3022950262 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:38.260 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.251+0000 7f21937fe700 1 --2- 172.21.15.139:0/3022950262 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21940a3f40 0x7f2194134df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:38.260 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.251+0000 7f2192ffd700 1 -- 172.21.15.139:0/3022950262 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21940a3f40 msgr2=0x7f2194134df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:38.261 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.251+0000 7f2192ffd700 1 --2- 172.21.15.139:0/3022950262 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21940a3f40 0x7f2194134df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:38.261 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.251+0000 7f2192ffd700 1 -- 172.21.15.139:0/3022950262 >> v1:172.21.15.139:6789/0 conn(0x7f21940a21f0 legacy=0x7f2194138340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:38.261 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.251+0000 7f2192ffd700 1 -- 172.21.15.139:0/3022950262 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21941356b0 con 0x7f2194135250 2020-02-12T14:12:38.261 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.251+0000 7f21927fc700 1 -- 172.21.15.139:0/3022950262 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438885639 0 0) 0x7f21941359e0 con 0x7f21940a21f0 2020-02-12T14:12:38.261 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.251+0000 7f2192ffd700 1 --2- 172.21.15.139:0/3022950262 >> v2:172.21.15.139:3300/0 conn(0x7f2194135250 0x7f21940a1d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f217c002f30 tx=0x7f217c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:38.261 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.251+0000 7f2192ffd700 1 --2- 172.21.15.139:0/3022950262 >> v2:172.21.15.139:3300/0 conn(0x7f2194135250 0x7f21940a1d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f217c002f30 tx=0x7f217c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:38.261 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.251+0000 7f2192ffd700 1 --2- 172.21.15.139:0/3022950262 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2194135250 0x7f21940a1d90 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f217c002f30 tx=0x7f217c0088e0).ready entity=mon.1 client_cookie=86773b58e1d7c68d server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:38.262 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.251+0000 7f2192ffd700 1 --2- 172.21.15.139:0/3022950262 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2194135250 0x7f21940a1d90 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f217c002f30 tx=0x7f217c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:38.262 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.251+0000 7f21927fc700 1 -- 172.21.15.139:0/3022950262 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f217c008e40 con 0x7f2194135250 2020-02-12T14:12:38.262 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.251+0000 7f2192ffd700 1 --2- 172.21.15.139:0/3022950262 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2194135250 0x7f21940a1d90 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f217c002f30 tx=0x7f217c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:38.262 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.251+0000 7f2192ffd700 1 --2- 172.21.15.139:0/3022950262 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2194135250 0x7f21940a1d90 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f217c002f30 tx=0x7f217c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:38.262 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.251+0000 7f21927fc700 1 -- 172.21.15.139:0/3022950262 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217c0116a0 con 0x7f2194135250 2020-02-12T14:12:38.262 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.251+0000 7f21927fc700 1 -- 172.21.15.139:0/3022950262 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f217c011a40 con 0x7f2194135250 2020-02-12T14:12:38.262 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.251+0000 7f2199e3d700 1 -- 172.21.15.139:0/3022950262 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2194135250 msgr2=0x7f21940a1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:38.263 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.251+0000 7f2199e3d700 1 --2- 172.21.15.139:0/3022950262 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2194135250 0x7f21940a1d90 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f217c002f30 tx=0x7f217c0088e0).stop 2020-02-12T14:12:38.263 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.252+0000 7f2199e3d700 1 -- 172.21.15.139:0/3022950262 shutdown_connections 2020-02-12T14:12:38.263 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.252+0000 7f2199e3d700 1 --2- 172.21.15.139:0/3022950262 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21940a3f40 0x7f2194134df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:38.263 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.252+0000 7f2199e3d700 1 --2- 172.21.15.139:0/3022950262 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2194135250 0x7f21940a1d90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:38.263 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.252+0000 7f2199e3d700 1 -- 172.21.15.139:0/3022950262 >> 172.21.15.139:0/3022950262 conn(0x7f2194060950 msgr2=0x7f219409d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:38.263 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.252+0000 7f2199e3d700 1 -- 172.21.15.139:0/3022950262 shutdown_connections 2020-02-12T14:12:38.263 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.252+0000 7f2199e3d700 1 -- 172.21.15.139:0/3022950262 wait complete. 2020-02-12T14:12:38.263 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.252+0000 7f2199e3d700 1 Processor -- start 2020-02-12T14:12:38.264 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.253+0000 7f2199e3d700 1 -- start start 2020-02-12T14:12:38.264 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.253+0000 7f2199e3d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21940a3f40 0x7f219412f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:38.264 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.253+0000 7f2199e3d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2194145ff0 con 0x7f2194135250 2020-02-12T14:12:38.264 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.253+0000 7f2199e3d700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21940a0cf0 con 0x7f21940a21f0 2020-02-12T14:12:38.264 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.253+0000 7f2199e3d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21940a1cb0 con 0x7f21940a3f40 2020-02-12T14:12:38.264 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.253+0000 7f21937fe700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f21940a21f0 0x7f21941458e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35178/0 (socket says 172.21.15.139:35178) 2020-02-12T14:12:38.264 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.253+0000 7f21937fe700 1 -- 172.21.15.139:0/926111229 learned_addr learned my addr 172.21.15.139:0/926111229 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:38.264 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.253+0000 7f2192ffd700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21940a3f40 0x7f219412f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:38.265 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.253+0000 7f2190ff9700 1 -- 172.21.15.139:0/926111229 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1194999072 0 0) 0x7f21940a0cf0 con 0x7f21940a21f0 2020-02-12T14:12:38.265 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.253+0000 7f2190ff9700 1 -- 172.21.15.139:0/926111229 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2178002fe0 con 0x7f21940a21f0 2020-02-12T14:12:38.265 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2190ff9700 1 -- 172.21.15.139:0/926111229 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 6373903 0 0) 0x7f2194145ff0 con 0x7f2194135250 2020-02-12T14:12:38.265 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2190ff9700 1 -- 172.21.15.139:0/926111229 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21940a0cf0 con 0x7f2194135250 2020-02-12T14:12:38.265 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2190ff9700 1 -- 172.21.15.139:0/926111229 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4273340630 0 0) 0x7f2178002fe0 con 0x7f21940a21f0 2020-02-12T14:12:38.265 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2190ff9700 1 -- 172.21.15.139:0/926111229 --> v1:172.21.15.139:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2194145ff0 con 0x7f21940a21f0 2020-02-12T14:12:38.265 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2190ff9700 1 -- 172.21.15.139:0/926111229 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7f2184002940 con 0x7f21940a21f0 2020-02-12T14:12:38.266 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2190ff9700 1 -- 172.21.15.139:0/926111229 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21940a3f40 msgr2=0x7f219412f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:38.266 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2190ff9700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21940a3f40 0x7f219412f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:38.266 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2190ff9700 1 -- 172.21.15.139:0/926111229 >> v1:172.21.15.139:6789/0 conn(0x7f21940a21f0 legacy=0x7f21941458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:38.266 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2190ff9700 1 -- 172.21.15.139:0/926111229 >> v1:172.21.15.72:6789/0 conn(0x7f2194135250 legacy=0x7f219414cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:38.266 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2190ff9700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2178004b20 0x7f2178004f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:38.266 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2190ff9700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2178003ab0 0x7f2178003f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:38.266 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2190ff9700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2178004370 0x7f217800b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:38.266 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2190ff9700 1 -- 172.21.15.139:0/926111229 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21940a1cb0 con 0x7f2178003ab0 2020-02-12T14:12:38.267 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2190ff9700 1 -- 172.21.15.139:0/926111229 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217800bbb0 con 0x7f2178004370 2020-02-12T14:12:38.267 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2190ff9700 1 -- 172.21.15.139:0/926111229 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217800bcf0 con 0x7f2178004b20 2020-02-12T14:12:38.267 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2192ffd700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21940a3f40 0x7f219412f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T14:12:38.267 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2193fff700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2178004370 0x7f217800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:38.267 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f21937fe700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2178004b20 0x7f2178004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:38.267 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2192ffd700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2178003ab0 0x7f2178003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:38.267 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2193fff700 1 -- 172.21.15.139:0/926111229 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2178004b20 msgr2=0x7f2178004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:38.268 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2193fff700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2178004b20 0x7f2178004f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:38.268 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2193fff700 1 -- 172.21.15.139:0/926111229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2178003ab0 msgr2=0x7f2178003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:38.268 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2193fff700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2178003ab0 0x7f2178003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:38.268 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2193fff700 1 -- 172.21.15.139:0/926111229 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2194132a40 con 0x7f2178004370 2020-02-12T14:12:38.268 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2199e3d700 1 -- 172.21.15.139:0/926111229 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21941321c0 con 0x7f2178004370 2020-02-12T14:12:38.268 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2192ffd700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2178003ab0 0x7f2178003f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T14:12:38.268 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2193fff700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2178004370 0x7f217800b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2178004a80 tx=0x7f218c00c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:38.269 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2199e3d700 1 -- 172.21.15.139:0/926111229 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2194130d80 con 0x7f2178004370 2020-02-12T14:12:38.269 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2193fff700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2178004370 0x7f217800b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2178004a80 tx=0x7f218c00c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:38.269 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2193fff700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2178004370 0x7f217800b750 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7f2178004a80 tx=0x7f218c00c5f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:38.269 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2193fff700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2178004370 0x7f217800b750 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f2178004a80 tx=0x7f218c00c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:38.269 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2190ff9700 1 -- 172.21.15.139:0/926111229 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f218c00c650 con 0x7f2178004370 2020-02-12T14:12:38.269 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.254+0000 7f2193fff700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2178004370 0x7f217800b750 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f2178004a80 tx=0x7f218c00c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:38.269 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.255+0000 7f2193fff700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2178004370 0x7f217800b750 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f2178004a80 tx=0x7f218c00c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:38.270 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.255+0000 7f2190ff9700 1 -- 172.21.15.139:0/926111229 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c00c7b0 con 0x7f2178004370 2020-02-12T14:12:38.270 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.255+0000 7f2190ff9700 1 -- 172.21.15.139:0/926111229 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f218c00cb50 con 0x7f2178004370 2020-02-12T14:12:38.270 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.255+0000 7f2193fff700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2178004370 0x7f217800b750 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f2178004a80 tx=0x7f218c00c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:38.270 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.255+0000 7f2199e3d700 1 -- 172.21.15.139:0/926111229 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216c003340 con 0x7f2178004370 2020-02-12T14:12:38.270 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.255+0000 7f2190ff9700 1 -- 172.21.15.139:0/926111229 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f218c00ccb0 con 0x7f2178004370 2020-02-12T14:12:38.270 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.255+0000 7f2193fff700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2178004370 0x7f217800b750 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f2178004a80 tx=0x7f218c00c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:38.270 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.255+0000 7f2190ff9700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f21780427f0 0x7f2178044cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:38.271 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.256+0000 7f2190ff9700 1 -- 172.21.15.139:0/926111229 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5915+0+0 (secure 0 0 0) 0x7f218c049540 con 0x7f2178004370 2020-02-12T14:12:38.271 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.256+0000 7f21937fe700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f21780427f0 0x7f2178044cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:38.271 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.256+0000 7f21937fe700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f21780427f0 0x7f2178044cb0 crc :-1 s=READY pgs=42 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:38.271 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.259+0000 7f2193fff700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2178004370 0x7f217800b750 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f2178004a80 tx=0x7f218c00c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:38.272 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.259+0000 7f2190ff9700 1 -- 172.21.15.139:0/926111229 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f218c02eb90 con 0x7f2178004370 2020-02-12T14:12:38.397 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:38.395+0000 7f2199e3d700 1 -- 172.21.15.139:0/926111229 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f216c002240 con 0x7f2178004370 2020-02-12T14:12:39.126 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.123+0000 7f2193fff700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2178004370 0x7f217800b750 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f2178004a80 tx=0x7f218c00c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.126 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.123+0000 7f2190ff9700 1 -- 172.21.15.139:0/926111229 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 3 allow_ec_overwrites to true v22) v1 ==== 166+0+0 (secure 0 0 0) 0x7f218c031680 con 0x7f2178004370 2020-02-12T14:12:39.129 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.127+0000 7f2199e3d700 1 -- 172.21.15.139:0/926111229 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f21780427f0 msgr2=0x7f2178044cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:39.130 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.127+0000 7f2199e3d700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f21780427f0 0x7f2178044cb0 crc :-1 s=READY pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:39.130 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.127+0000 7f2199e3d700 1 -- 172.21.15.139:0/926111229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2178004370 msgr2=0x7f217800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:39.130 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.127+0000 7f2199e3d700 1 --2- 172.21.15.139:0/926111229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2178004370 0x7f217800b750 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7f2178004a80 tx=0x7f218c00c5f0).stop 2020-02-12T14:12:39.130 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.127+0000 7f2193fff700 1 -- 172.21.15.139:0/926111229 reap_dead start 2020-02-12T14:12:39.130 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.127+0000 7f2193fff700 1 -- 172.21.15.139:0/926111229 reap_dead start 2020-02-12T14:12:39.130 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.127+0000 7f2199e3d700 1 -- 172.21.15.139:0/926111229 shutdown_connections 2020-02-12T14:12:39.130 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.127+0000 7f2199e3d700 1 -- 172.21.15.139:0/926111229 >> 172.21.15.139:0/926111229 conn(0x7f2194060950 msgr2=0x7f219405e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:39.131 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.127+0000 7f2199e3d700 1 -- 172.21.15.139:0/926111229 shutdown_connections 2020-02-12T14:12:39.131 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.127+0000 7f2199e3d700 1 -- 172.21.15.139:0/926111229 wait complete. 2020-02-12T14:12:39.131 INFO:teuthology.orchestra.run.smithi139.stderr:set pool 3 allow_ec_overwrites to true 2020-02-12T14:12:39.142 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-02-12T14:12:39.256 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.254+0000 7fec09b0a700 1 Processor -- start 2020-02-12T14:12:39.256 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.254+0000 7fec09b0a700 1 -- start start 2020-02-12T14:12:39.259 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.255+0000 7fec09b0a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec040a3f40 0x7fec04134df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:39.259 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.255+0000 7fec09b0a700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fec040a24a0 0x7fec0412e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:39.260 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.255+0000 7fec09b0a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec041359e0 con 0x7fec04135250 2020-02-12T14:12:39.260 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.255+0000 7fec09b0a700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec04135c80 con 0x7fec040a24a0 2020-02-12T14:12:39.260 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.255+0000 7fec09b0a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec040a18f0 con 0x7fec040a3f40 2020-02-12T14:12:39.260 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.255+0000 7fec03fff700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fec040a24a0 0x7fec0412e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:39.260 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.255+0000 7fec03fff700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fec040a24a0 0x7fec0412e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46558/0 (socket says 172.21.15.139:46558) 2020-02-12T14:12:39.260 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.255+0000 7fec03fff700 1 -- 172.21.15.139:0/1511425445 learned_addr learned my addr 172.21.15.139:0/1511425445 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:39.260 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.255+0000 7fec03fff700 1 -- 172.21.15.139:0/1511425445 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec040a3f40 msgr2=0x7fec04134df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:39.261 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.255+0000 7fec037fe700 1 --2- 172.21.15.139:0/1511425445 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec040a3f40 0x7fec04134df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:39.261 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.255+0000 7fec03fff700 1 --2- 172.21.15.139:0/1511425445 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec040a3f40 0x7fec04134df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:39.261 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.255+0000 7fec03fff700 1 -- 172.21.15.139:0/1511425445 >> v1:172.21.15.72:6789/0 conn(0x7fec04135250 legacy=0x7fec040a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:39.261 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.255+0000 7fec03fff700 1 -- 172.21.15.139:0/1511425445 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec041356b0 con 0x7fec040a24a0 2020-02-12T14:12:39.261 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.255+0000 7fec037fe700 1 --2- 172.21.15.139:0/1511425445 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec040a3f40 0x7fec04134df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-12T14:12:39.261 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.255+0000 7fec03fff700 1 --2- 172.21.15.139:0/1511425445 >> v2:172.21.15.139:3300/0 conn(0x7fec040a24a0 0x7fec0412e6b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fec040a1c70 tx=0x7febfc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.261 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.255+0000 7fec03fff700 1 --2- 172.21.15.139:0/1511425445 >> v2:172.21.15.139:3300/0 conn(0x7fec040a24a0 0x7fec0412e6b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fec040a1c70 tx=0x7febfc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.262 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.255+0000 7fec03fff700 1 --2- 172.21.15.139:0/1511425445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fec040a24a0 0x7fec0412e6b0 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7fec040a1c70 tx=0x7febfc008c60).ready entity=mon.1 client_cookie=f67d1ddac6758147 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:39.262 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.255+0000 7fec03fff700 1 --2- 172.21.15.139:0/1511425445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fec040a24a0 0x7fec0412e6b0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fec040a1c70 tx=0x7febfc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.262 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.255+0000 7fec02ffd700 1 -- 172.21.15.139:0/1511425445 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febfc00a160 con 0x7fec040a24a0 2020-02-12T14:12:39.262 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.255+0000 7fec03fff700 1 --2- 172.21.15.139:0/1511425445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fec040a24a0 0x7fec0412e6b0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fec040a1c70 tx=0x7febfc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.262 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.255+0000 7fec03fff700 1 --2- 172.21.15.139:0/1511425445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fec040a24a0 0x7fec0412e6b0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fec040a1c70 tx=0x7febfc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.262 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.255+0000 7fec02ffd700 1 -- 172.21.15.139:0/1511425445 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febfc00a2c0 con 0x7fec040a24a0 2020-02-12T14:12:39.262 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.256+0000 7fec02ffd700 1 -- 172.21.15.139:0/1511425445 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febfc00a660 con 0x7fec040a24a0 2020-02-12T14:12:39.263 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.256+0000 7fec09b0a700 1 -- 172.21.15.139:0/1511425445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fec040a24a0 msgr2=0x7fec0412e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:39.263 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.256+0000 7fec09b0a700 1 --2- 172.21.15.139:0/1511425445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fec040a24a0 0x7fec0412e6b0 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7fec040a1c70 tx=0x7febfc008c60).stop 2020-02-12T14:12:39.263 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.256+0000 7fec09b0a700 1 -- 172.21.15.139:0/1511425445 shutdown_connections 2020-02-12T14:12:39.263 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.256+0000 7fec09b0a700 1 --2- 172.21.15.139:0/1511425445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fec040a24a0 0x7fec0412e6b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:39.263 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.256+0000 7fec09b0a700 1 --2- 172.21.15.139:0/1511425445 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec040a3f40 0x7fec04134df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:39.263 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.256+0000 7fec09b0a700 1 -- 172.21.15.139:0/1511425445 >> 172.21.15.139:0/1511425445 conn(0x7fec04060950 msgr2=0x7fec0409d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:39.263 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.256+0000 7fec09b0a700 1 -- 172.21.15.139:0/1511425445 shutdown_connections 2020-02-12T14:12:39.264 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.256+0000 7fec09b0a700 1 -- 172.21.15.139:0/1511425445 wait complete. 2020-02-12T14:12:39.264 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.257+0000 7fec09b0a700 1 Processor -- start 2020-02-12T14:12:39.264 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.257+0000 7fec09b0a700 1 -- start start 2020-02-12T14:12:39.267 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.257+0000 7fec09b0a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fec040a3f40 0x7fec041307c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:39.267 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.258+0000 7fec09b0a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec0409e510 con 0x7fec040a24a0 2020-02-12T14:12:39.267 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.258+0000 7fec09b0a700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec0412d9e0 con 0x7fec04135250 2020-02-12T14:12:39.268 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.258+0000 7fec09b0a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec0409f120 con 0x7fec040a3f40 2020-02-12T14:12:39.268 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.258+0000 7fec03fff700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fec04135250 0x7fec0412aad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35202/0 (socket says 172.21.15.139:35202) 2020-02-12T14:12:39.268 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.258+0000 7fec03fff700 1 -- 172.21.15.139:0/1738097114 learned_addr learned my addr 172.21.15.139:0/1738097114 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:39.268 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.258+0000 7febfbfff700 1 --2- 172.21.15.139:0/1738097114 >> v2:172.21.15.72:3300/0 conn(0x7fec040a3f40 0x7fec041307c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:39.268 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.258+0000 7fec017fa700 1 -- 172.21.15.139:0/1738097114 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3091867271 0 0) 0x7fec0412d9e0 con 0x7fec04135250 2020-02-12T14:12:39.268 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.258+0000 7fec017fa700 1 -- 172.21.15.139:0/1738097114 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febe8002fe0 con 0x7fec04135250 2020-02-12T14:12:39.268 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.258+0000 7fec017fa700 1 -- 172.21.15.139:0/1738097114 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4239045161 0 0) 0x7febe8002fe0 con 0x7fec04135250 2020-02-12T14:12:39.269 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.258+0000 7fec017fa700 1 -- 172.21.15.139:0/1738097114 --> v1:172.21.15.139:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fec0412d9e0 con 0x7fec04135250 2020-02-12T14:12:39.269 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.258+0000 7fec017fa700 1 -- 172.21.15.139:0/1738097114 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7febfc011da0 con 0x7fec04135250 2020-02-12T14:12:39.269 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.258+0000 7febfbfff700 1 -- 172.21.15.139:0/1738097114 >> v1:172.21.15.139:6789/0 conn(0x7fec04135250 legacy=0x7fec0412aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:39.269 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.258+0000 7febfbfff700 1 -- 172.21.15.139:0/1738097114 >> v1:172.21.15.72:6789/0 conn(0x7fec040a24a0 legacy=0x7fec04131260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:39.269 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.258+0000 7febfbfff700 1 -- 172.21.15.139:0/1738097114 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec04130df0 con 0x7fec040a3f40 2020-02-12T14:12:39.269 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.258+0000 7febfbfff700 1 --2- 172.21.15.139:0/1738097114 >> v2:172.21.15.72:3300/0 conn(0x7fec040a3f40 0x7fec041307c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7febf4007720 tx=0x7febec010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.269 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.258+0000 7febfbfff700 1 --2- 172.21.15.139:0/1738097114 >> v2:172.21.15.72:3300/0 conn(0x7fec040a3f40 0x7fec041307c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7febf4007720 tx=0x7febec010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.270 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.258+0000 7febfbfff700 1 --2- 172.21.15.139:0/1738097114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec040a3f40 0x7fec041307c0 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7febf4007720 tx=0x7febec010830).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:39.270 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.258+0000 7febfbfff700 1 --2- 172.21.15.139:0/1738097114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec040a3f40 0x7fec041307c0 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7febf4007720 tx=0x7febec010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.270 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.258+0000 7fec017fa700 1 -- 172.21.15.139:0/1738097114 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febec0069b0 con 0x7fec040a3f40 2020-02-12T14:12:39.270 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.258+0000 7febfbfff700 1 --2- 172.21.15.139:0/1738097114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec040a3f40 0x7fec041307c0 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7febf4007720 tx=0x7febec010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.270 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.258+0000 7fec017fa700 1 -- 172.21.15.139:0/1738097114 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec006b10 con 0x7fec040a3f40 2020-02-12T14:12:39.270 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.258+0000 7febfbfff700 1 --2- 172.21.15.139:0/1738097114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec040a3f40 0x7fec041307c0 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7febf4007720 tx=0x7febec010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.270 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.258+0000 7fec09b0a700 1 -- 172.21.15.139:0/1738097114 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0409e9e0 con 0x7fec040a3f40 2020-02-12T14:12:39.271 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.258+0000 7fec017fa700 1 -- 172.21.15.139:0/1738097114 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febec006e70 con 0x7fec040a3f40 2020-02-12T14:12:39.271 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.258+0000 7fec09b0a700 1 -- 172.21.15.139:0/1738097114 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec04135ee0 con 0x7fec040a3f40 2020-02-12T14:12:39.271 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.259+0000 7febfbfff700 1 --2- 172.21.15.139:0/1738097114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec040a3f40 0x7fec041307c0 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7febf4007720 tx=0x7febec010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.271 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.259+0000 7fec09b0a700 1 -- 172.21.15.139:0/1738097114 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec0409ee50 con 0x7fec040a3f40 2020-02-12T14:12:39.271 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.259+0000 7fec017fa700 1 -- 172.21.15.139:0/1738097114 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7febec00a280 con 0x7fec040a3f40 2020-02-12T14:12:39.271 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.259+0000 7febfbfff700 1 --2- 172.21.15.139:0/1738097114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec040a3f40 0x7fec041307c0 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7febf4007720 tx=0x7febec010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.271 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.260+0000 7fec017fa700 1 --2- 172.21.15.139:0/1738097114 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7febe803a180 0x7febe803c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:39.272 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.260+0000 7fec017fa700 1 -- 172.21.15.139:0/1738097114 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5915+0+0 (secure 0 0 0) 0x7febec002e40 con 0x7fec040a3f40 2020-02-12T14:12:39.272 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.260+0000 7fec037fe700 1 --2- 172.21.15.139:0/1738097114 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7febe803a180 0x7febe803c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:39.272 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.260+0000 7fec037fe700 1 --2- 172.21.15.139:0/1738097114 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7febe803a180 0x7febe803c640 crc :-1 s=READY pgs=43 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:39.272 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.264+0000 7febfbfff700 1 --2- 172.21.15.139:0/1738097114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec040a3f40 0x7fec041307c0 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7febf4007720 tx=0x7febec010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.272 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.264+0000 7fec017fa700 1 -- 172.21.15.139:0/1738097114 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7febec02ed20 con 0x7fec040a3f40 2020-02-12T14:12:39.447 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.445+0000 7fec09b0a700 1 -- 172.21.15.139:0/1738097114 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fec04067e20 con 0x7fec040a3f40 2020-02-12T14:12:39.448 INFO:tasks.ceph.mon.b.smithi072.stderr:2020-02-12T14:12:39.446+0000 7fa0baae5700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-02-12T14:12:39.452 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.450+0000 7febfbfff700 1 --2- 172.21.15.139:0/1738097114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec040a3f40 0x7fec041307c0 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7febf4007720 tx=0x7febec010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.453 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.450+0000 7fec017fa700 1 -- 172.21.15.139:0/1738097114 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 2 and data pool 3 v2) v1 ==== 187+0+0 (secure 0 0 0) 0x7febec031830 con 0x7fec040a3f40 2020-02-12T14:12:39.454 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.452+0000 7fec09b0a700 1 -- 172.21.15.139:0/1738097114 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7febe803a180 msgr2=0x7febe803c640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:39.454 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.452+0000 7fec09b0a700 1 --2- 172.21.15.139:0/1738097114 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7febe803a180 0x7febe803c640 crc :-1 s=READY pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:39.455 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.452+0000 7fec09b0a700 1 -- 172.21.15.139:0/1738097114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec040a3f40 msgr2=0x7fec041307c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:39.455 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.452+0000 7fec09b0a700 1 --2- 172.21.15.139:0/1738097114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec040a3f40 0x7fec041307c0 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7febf4007720 tx=0x7febec010830).stop 2020-02-12T14:12:39.455 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.452+0000 7fec09b0a700 1 -- 172.21.15.139:0/1738097114 shutdown_connections 2020-02-12T14:12:39.455 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.452+0000 7fec09b0a700 1 --2- 172.21.15.139:0/1738097114 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7febe803a180 0x7febe803c640 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:39.455 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.452+0000 7fec09b0a700 1 --2- 172.21.15.139:0/1738097114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec040a3f40 0x7fec041307c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:39.455 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.452+0000 7fec09b0a700 1 -- 172.21.15.139:0/1738097114 >> 172.21.15.139:0/1738097114 conn(0x7fec04060950 msgr2=0x7fec0405e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:39.455 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.452+0000 7fec09b0a700 1 -- 172.21.15.139:0/1738097114 shutdown_connections 2020-02-12T14:12:39.455 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.452+0000 7fec09b0a700 1 -- 172.21.15.139:0/1738097114 wait complete. 2020-02-12T14:12:39.456 INFO:teuthology.orchestra.run.smithi139.stderr:new fs with metadata pool 2 and data pool 3 2020-02-12T14:12:39.464 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-12T14:12:39.569 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.566+0000 7f9957f30700 1 Processor -- start 2020-02-12T14:12:39.569 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.567+0000 7f9957f30700 1 -- start start 2020-02-12T14:12:39.575 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.567+0000 7f9957f30700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9950131cc0 0x7f995013fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:39.575 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.567+0000 7f9957f30700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99500a2fb0 con 0x7f99500a7ac0 2020-02-12T14:12:39.575 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.567+0000 7f9957f30700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99500a60f0 con 0x7f99500a5a50 2020-02-12T14:12:39.576 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.567+0000 7f9957f30700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99500a2360 con 0x7f9950131cc0 2020-02-12T14:12:39.576 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.567+0000 7f99554cb700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f99500a5a50 0x7f99501315b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35206/0 (socket says 172.21.15.139:35206) 2020-02-12T14:12:39.576 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.567+0000 7f99554cb700 1 -- 172.21.15.139:0/1615617166 learned_addr learned my addr 172.21.15.139:0/1615617166 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:39.576 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f9954cca700 1 -- 172.21.15.139:0/1615617166 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4142026006 0 0) 0x7f99500a60f0 con 0x7f99500a5a50 2020-02-12T14:12:39.576 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f9954cca700 1 -- 172.21.15.139:0/1615617166 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9938003230 con 0x7f99500a5a50 2020-02-12T14:12:39.576 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f99564cd700 1 --2- 172.21.15.139:0/1615617166 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9950131cc0 0x7f995013fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:39.576 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f9954cca700 1 -- 172.21.15.139:0/1615617166 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1703020838 0 0) 0x7f9938003230 con 0x7f99500a5a50 2020-02-12T14:12:39.577 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f9954cca700 1 -- 172.21.15.139:0/1615617166 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9950131cc0 msgr2=0x7f995013fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:39.577 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f9954cca700 1 --2- 172.21.15.139:0/1615617166 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9950131cc0 0x7f995013fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:39.577 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f9954cca700 1 -- 172.21.15.139:0/1615617166 >> v1:172.21.15.72:6789/0 conn(0x7f99500a7ac0 legacy=0x7f99500a3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:39.577 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f9954cca700 1 -- 172.21.15.139:0/1615617166 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99500a3680 con 0x7f99500a5a50 2020-02-12T14:12:39.577 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f9954cca700 1 -- 172.21.15.139:0/1615617166 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7f994c0016d0 con 0x7f99500a5a50 2020-02-12T14:12:39.577 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f9954cca700 1 -- 172.21.15.139:0/1615617166 >> v1:172.21.15.139:6789/0 conn(0x7f99500a5a50 legacy=0x7f99501315b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:39.577 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f9954cca700 1 --2- 172.21.15.139:0/1615617166 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9950131cc0 0x7f9938003780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:39.578 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f9954cca700 1 --2- 172.21.15.139:0/1615617166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9938003be0 0x7f99380044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:39.578 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f9954cca700 1 --2- 172.21.15.139:0/1615617166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9938004930 0x7f9938004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:39.578 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f9954cca700 1 -- 172.21.15.139:0/1615617166 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99500a2360 con 0x7f9938004930 2020-02-12T14:12:39.578 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f9954cca700 1 -- 172.21.15.139:0/1615617166 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9938005360 con 0x7f9938003be0 2020-02-12T14:12:39.578 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f9954cca700 1 -- 172.21.15.139:0/1615617166 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99380041d0 con 0x7f9950131cc0 2020-02-12T14:12:39.578 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f99554cb700 1 --2- 172.21.15.139:0/1615617166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9938003be0 0x7f99380044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:39.578 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f9955ccc700 1 --2- 172.21.15.139:0/1615617166 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9950131cc0 0x7f9938003780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:39.579 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f99564cd700 1 --2- 172.21.15.139:0/1615617166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9938004930 0x7f9938004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:39.579 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f99554cb700 1 -- 172.21.15.139:0/1615617166 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9950131cc0 msgr2=0x7f9938003780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:39.579 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f99554cb700 1 --2- 172.21.15.139:0/1615617166 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9950131cc0 0x7f9938003780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:39.579 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f99554cb700 1 -- 172.21.15.139:0/1615617166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9938004930 msgr2=0x7f9938004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:39.579 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f99554cb700 1 --2- 172.21.15.139:0/1615617166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9938004930 0x7f9938004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:39.579 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f99554cb700 1 -- 172.21.15.139:0/1615617166 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9938003230 con 0x7f9938003be0 2020-02-12T14:12:39.579 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f99554cb700 1 --2- 172.21.15.139:0/1615617166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9938003be0 0x7f99380044d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f994c0013e0 tx=0x7f99500a7ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.579 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f99554cb700 1 --2- 172.21.15.139:0/1615617166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9938003be0 0x7f99380044d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f994c0013e0 tx=0x7f99500a7ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.580 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.568+0000 7f99554cb700 1 --2- 172.21.15.139:0/1615617166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9938003be0 0x7f99380044d0 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f994c0013e0 tx=0x7f99500a7ea0).ready entity=mon.1 client_cookie=22550498edee0418 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:39.580 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.569+0000 7f99554cb700 1 --2- 172.21.15.139:0/1615617166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9938003be0 0x7f99380044d0 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f994c0013e0 tx=0x7f99500a7ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.580 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.569+0000 7f99554cb700 1 --2- 172.21.15.139:0/1615617166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9938003be0 0x7f99380044d0 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f994c0013e0 tx=0x7f99500a7ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.580 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.569+0000 7f9954cca700 1 -- 172.21.15.139:0/1615617166 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f994c00ce70 con 0x7f9938003be0 2020-02-12T14:12:39.580 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.569+0000 7f99554cb700 1 --2- 172.21.15.139:0/1615617166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9938003be0 0x7f99380044d0 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f994c0013e0 tx=0x7f99500a7ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.580 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.569+0000 7f9954cca700 1 -- 172.21.15.139:0/1615617166 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994c00e350 con 0x7f9938003be0 2020-02-12T14:12:39.580 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.569+0000 7f9954cca700 1 -- 172.21.15.139:0/1615617166 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f994c00e6f0 con 0x7f9938003be0 2020-02-12T14:12:39.581 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.569+0000 7f9957f30700 1 -- 172.21.15.139:0/1615617166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9938003be0 msgr2=0x7f99380044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:39.581 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.569+0000 7f9957f30700 1 --2- 172.21.15.139:0/1615617166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9938003be0 0x7f99380044d0 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f994c0013e0 tx=0x7f99500a7ea0).stop 2020-02-12T14:12:39.581 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.569+0000 7f99564cd700 1 -- 172.21.15.139:0/1615617166 reap_dead start 2020-02-12T14:12:39.581 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.569+0000 7f9957f30700 1 -- 172.21.15.139:0/1615617166 shutdown_connections 2020-02-12T14:12:39.581 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.569+0000 7f9957f30700 1 -- 172.21.15.139:0/1615617166 >> 172.21.15.139:0/1615617166 conn(0x7f9950060950 msgr2=0x7f995009d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:39.581 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.569+0000 7f9957f30700 1 -- 172.21.15.139:0/1615617166 shutdown_connections 2020-02-12T14:12:39.581 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.569+0000 7f9957f30700 1 -- 172.21.15.139:0/1615617166 wait complete. 2020-02-12T14:12:39.582 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.570+0000 7f9957f30700 1 Processor -- start 2020-02-12T14:12:39.582 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.570+0000 7f9957f30700 1 -- start start 2020-02-12T14:12:39.582 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.571+0000 7f9957f30700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f99500a0460 0x7f9950137b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:39.582 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.571+0000 7f9957f30700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9950134730 0x7f995009ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:39.582 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.571+0000 7f9957f30700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f995009f080 con 0x7f99500a1240 2020-02-12T14:12:39.582 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.571+0000 7f9957f30700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9950134ba0 con 0x7f9950134730 2020-02-12T14:12:39.582 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.571+0000 7f9957f30700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99500a0970 con 0x7f99500a0460 2020-02-12T14:12:39.582 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.571+0000 7f99554cb700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f99500a0460 0x7f9950137b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:39.583 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.571+0000 7f99554cb700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f99500a0460 0x7f9950137b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46582/0 (socket says 172.21.15.139:46582) 2020-02-12T14:12:39.583 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.571+0000 7f99554cb700 1 -- 172.21.15.139:0/3657601158 learned_addr learned my addr 172.21.15.139:0/3657601158 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:39.583 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.571+0000 7f99564cd700 1 --2- 172.21.15.139:0/3657601158 >> v2:172.21.15.72:3300/0 conn(0x7f9950134730 0x7f995009ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:39.583 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.571+0000 7f99554cb700 1 -- 172.21.15.139:0/3657601158 >> v2:172.21.15.72:3300/0 conn(0x7f9950134730 msgr2=0x7f995009ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:39.583 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.571+0000 7f99554cb700 1 --2- 172.21.15.139:0/3657601158 >> v2:172.21.15.72:3300/0 conn(0x7f9950134730 0x7f995009ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:39.583 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.571+0000 7f99554cb700 1 -- 172.21.15.139:0/3657601158 >> v1:172.21.15.72:6789/0 conn(0x7f99500a1240 legacy=0x7f9950144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:39.583 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.571+0000 7f99554cb700 1 -- 172.21.15.139:0/3657601158 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99501376a0 con 0x7f99500a0460 2020-02-12T14:12:39.583 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.571+0000 7f99564cd700 1 --2- 172.21.15.139:0/3657601158 >> v2:172.21.15.72:3300/0 conn(0x7f9950134730 0x7f995009ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T14:12:39.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.571+0000 7f99554cb700 1 --2- 172.21.15.139:0/3657601158 >> v2:172.21.15.139:3300/0 conn(0x7f99500a0460 0x7f9950137b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f994c0013e0 tx=0x7f99500a7ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.571+0000 7f99554cb700 1 --2- 172.21.15.139:0/3657601158 >> v2:172.21.15.139:3300/0 conn(0x7f99500a0460 0x7f9950137b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f994c0013e0 tx=0x7f99500a7ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.571+0000 7f99554cb700 1 --2- 172.21.15.139:0/3657601158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99500a0460 0x7f9950137b40 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f994c0013e0 tx=0x7f99500a7ea0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:39.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.571+0000 7f99554cb700 1 --2- 172.21.15.139:0/3657601158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99500a0460 0x7f9950137b40 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f994c0013e0 tx=0x7f99500a7ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.571+0000 7f9942ffd700 1 -- 172.21.15.139:0/3657601158 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f994c0018e0 con 0x7f99500a0460 2020-02-12T14:12:39.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.571+0000 7f99554cb700 1 --2- 172.21.15.139:0/3657601158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99500a0460 0x7f9950137b40 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f994c0013e0 tx=0x7f99500a7ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.571+0000 7f99554cb700 1 --2- 172.21.15.139:0/3657601158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99500a0460 0x7f9950137b40 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f994c0013e0 tx=0x7f99500a7ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.571+0000 7f9942ffd700 1 -- 172.21.15.139:0/3657601158 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994c001a40 con 0x7f99500a0460 2020-02-12T14:12:39.585 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.571+0000 7f9942ffd700 1 -- 172.21.15.139:0/3657601158 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f994c0047a0 con 0x7f99500a0460 2020-02-12T14:12:39.585 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.571+0000 7f9957f30700 1 -- 172.21.15.139:0/3657601158 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99500a0c10 con 0x7f99500a0460 2020-02-12T14:12:39.585 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.571+0000 7f9957f30700 1 -- 172.21.15.139:0/3657601158 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9950145240 con 0x7f99500a0460 2020-02-12T14:12:39.585 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.572+0000 7f99554cb700 1 --2- 172.21.15.139:0/3657601158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99500a0460 0x7f9950137b40 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f994c0013e0 tx=0x7f99500a7ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.585 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.572+0000 7f9942ffd700 1 -- 172.21.15.139:0/3657601158 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f994c004a20 con 0x7f99500a0460 2020-02-12T14:12:39.585 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.572+0000 7f99554cb700 1 --2- 172.21.15.139:0/3657601158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99500a0460 0x7f9950137b40 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f994c0013e0 tx=0x7f99500a7ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.585 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.572+0000 7f9942ffd700 1 --2- 172.21.15.139:0/3657601158 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f9930039ba0 0x7f993003c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:39.586 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.572+0000 7f9942ffd700 1 -- 172.21.15.139:0/3657601158 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f994c04be80 con 0x7f99500a0460 2020-02-12T14:12:39.586 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.572+0000 7f9957f30700 1 -- 172.21.15.139:0/3657601158 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9950067e20 con 0x7f99500a0460 2020-02-12T14:12:39.586 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.572+0000 7f9955ccc700 1 --2- 172.21.15.139:0/3657601158 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f9930039ba0 0x7f993003c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:39.586 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.573+0000 7f9955ccc700 1 --2- 172.21.15.139:0/3657601158 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f9930039ba0 0x7f993003c060 crc :-1 s=READY pgs=44 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:39.586 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.576+0000 7f99554cb700 1 --2- 172.21.15.139:0/3657601158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99500a0460 0x7f9950137b40 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f994c0013e0 tx=0x7f99500a7ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.587 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.576+0000 7f9942ffd700 1 -- 172.21.15.139:0/3657601158 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f994c031570 con 0x7f99500a0460 2020-02-12T14:12:39.712 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.710+0000 7f9957f30700 1 -- 172.21.15.139:0/3657601158 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9950059fd0 con 0x7f99500a0460 2020-02-12T14:12:39.713 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.710+0000 7f99554cb700 1 --2- 172.21.15.139:0/3657601158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99500a0460 0x7f9950137b40 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f994c0013e0 tx=0x7f99500a7ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.713 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.710+0000 7f9942ffd700 1 -- 172.21.15.139:0/3657601158 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14933 (secure 0 0 0) 0x7f994c004cb0 con 0x7f99500a0460 2020-02-12T14:12:39.713 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:12:39.713 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":23,"fsid":"dacc9a6c-9e88-46ac-940b-c4a329dbffec","created":"2020-02-12T14:12:18.258232+0000","modified":"2020-02-12T14:12:39.447885+0000","last_up_change":"2020-02-12T14:12:27.050924+0000","last_in_change":"2020-02-12T14:12:27.050924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-12T14:12:31.091380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-02-12T14:12:34.160095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-02-12T14:12:37.119732+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffc0664d-9b93-45a4-a454-7655ee26d582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":22147},{"type":"v1","addr":"172.21.15.139:6803","nonce":22147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":22147},{"type":"v1","addr":"172.21.15.139:6805","nonce":22147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":22147},{"type":"v1","addr":"172.21.15.139:6809","nonce":22147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":22147},{"type":"v1","addr":"172.21.15.139:6807","nonce":22147}]},"public_addr":"172.21.15.139:6803/22147","cluster_addr":"172.21.15.139:6805/22147","heartbeat_back_addr":"172.21.15.139:6809/22147","heartbeat_front_addr":"172.21.15.139:6807/22147","state":["exists","up"]},{"osd":1,"uuid":"f66da6bc-43b3-4846-85f9-a25e3fe95216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":22148},{"type":"v1","addr":"172.21.15.139:6811","nonce":22148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":22148},{"type":"v1","addr":"172.21.15.139:6813","nonce":22148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6819","nonce":22148},{"type":"v1","addr":"172.21.15.139:6821","nonce":22148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6815","nonce":22148},{"type":"v1","addr":"172.21.15.139:6817","nonce":22148}]},"public_addr":"172.21.15.139:6811/22148","cluster_addr":"172.21.15.139:6813/22148","heartbeat_back_addr":"172.21.15.139:6821/22148","heartbeat_front_addr":"172.21.15.139:6817/22148","state":["exists","up"]},{"osd":2,"uuid":"c35fb293-3e16-41e8-85f3-768e11e55b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":22149},{"type":"v1","addr":"172.21.15.139:6827","nonce":22149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":22149},{"type":"v1","addr":"172.21.15.139:6829","nonce":22149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":22149},{"type":"v1","addr":"172.21.15.139:6833","nonce":22149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":22149},{"type":"v1","addr":"172.21.15.139:6831","nonce":22149}]},"public_addr":"172.21.15.139:6827/22149","cluster_addr":"172.21.15.139:6829/22149","heartbeat_back_addr":"172.21.15.139:6833/22149","heartbeat_front_addr":"172.21.15.139:6831/22149","state":["exists","up"]},{"osd":3,"uuid":"bc8b2c0d-e3dd-48cb-883e-6ea965aee923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":22150},{"type":"v1","addr":"172.21.15.139:6816","nonce":22150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":22150},{"type":"v1","addr":"172.21.15.139:6820","nonce":22150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":22150},{"type":"v1","addr":"172.21.15.139:6825","nonce":22150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":22150},{"type":"v1","addr":"172.21.15.139:6823","nonce":22150}]},"public_addr":"172.21.15.139:6816/22150","cluster_addr":"172.21.15.139:6820/22150","heartbeat_back_addr":"172.21.15.139:6825/22150","heartbeat_front_addr":"172.21.15.139:6823/22150","state":["exists","up"]},{"osd":4,"uuid":"aadfc406-0c40-4b6b-9e19-c92b2f40264a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":21598},{"type":"v1","addr":"172.21.15.72:6801","nonce":21598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":21598},{"type":"v1","addr":"172.21.15.72:6803","nonce":21598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":21598},{"type":"v1","addr":"172.21.15.72:6807","nonce":21598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":21598},{"type":"v1","addr":"172.21.15.72:6805","nonce":21598}]},"public_addr":"172.21.15.72:6801/21598","cluster_addr":"172.21.15.72:6803/21598","heartbeat_back_addr":"172.21.15.72:6807/21598","heartbeat_front_addr":"172.21.15.72:6805/21598","state":["exists","up"]},{"osd":5,"uuid":"3296dc8e-9322-4430-abd2-7672da5b7acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":21599},{"type":"v1","addr":"172.21.15.72:6810","nonce":21599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":21599},{"type":"v1","addr":"172.21.15.72:6815","nonce":21599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":21599},{"type":"v1","addr":"172.21.15.72:6823","nonce":21599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":21599},{"type":"v1","addr":"172.21.15.72:6820","nonce":21599}]},"public_addr":"172.21.15.72:6810/21599","cluster_addr":"172.21.15.72:6815/21599","heartbeat_back_addr":"172.21.15.72:6823/21599","heartbeat_front_addr":"172.21.15.72:6820/21599","state":["exists","up"]},{"osd":6,"uuid":"7c39cf20-a3a8-4d56-8577-f4102b302a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":21601},{"type":"v1","addr":"172.21.15.72:6811","nonce":21601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":21601},{"type":"v1","addr":"172.21.15.72:6814","nonce":21601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":21601},{"type":"v1","addr":"172.21.15.72:6821","nonce":21601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":21601},{"type":"v1","addr":"172.21.15.72:6818","nonce":21601}]},"public_addr":"172.21.15.72:6811/21601","cluster_addr":"172.21.15.72:6814/21601","heartbeat_back_addr":"172.21.15.72:6821/21601","heartbeat_front_addr":"172.21.15.72:6818/21601","state":["exists","up"]},{"osd":7,"uuid":"f452adff-8432-47e9-a5f1-9fd7e2a04a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":21600},{"type":"v1","addr":"172.21.15.72:6825","nonce":21600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":21600},{"type":"v1","addr":"172.21.15.72:6827","nonce":21600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":21600},{"type":"v1","addr":"172.21.15.72:6831","nonce":21600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":21600},{"type":"v1","addr":"172.21.15.72:6829","nonce":21600}]},"public_addr":"172.21.15.72:6825/21600","cluster_addr":"172.21.15.72:6827/21600","heartbeat_back_addr":"172.21.15.72:6831/21600","heartbeat_front_addr":"172.21.15.72:6829/21600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.259782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.267019+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.315501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.326256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.335328+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.284130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.083179+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.351445+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-12T14:12:39.715 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.712+0000 7f9957f30700 1 -- 172.21.15.139:0/3657601158 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f9930039ba0 msgr2=0x7f993003c060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:39.715 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.712+0000 7f9957f30700 1 --2- 172.21.15.139:0/3657601158 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f9930039ba0 0x7f993003c060 crc :-1 s=READY pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:39.715 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.712+0000 7f9957f30700 1 -- 172.21.15.139:0/3657601158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99500a0460 msgr2=0x7f9950137b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:39.715 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.712+0000 7f9957f30700 1 --2- 172.21.15.139:0/3657601158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99500a0460 0x7f9950137b40 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f994c0013e0 tx=0x7f99500a7ea0).stop 2020-02-12T14:12:39.715 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.712+0000 7f9957f30700 1 -- 172.21.15.139:0/3657601158 shutdown_connections 2020-02-12T14:12:39.715 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.712+0000 7f9957f30700 1 --2- 172.21.15.139:0/3657601158 >> v2:172.21.15.72:3300/0 conn(0x7f9950134730 0x7f995009ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:39.716 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.712+0000 7f9957f30700 1 --2- 172.21.15.139:0/3657601158 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f9930039ba0 0x7f993003c060 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:39.716 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.712+0000 7f9957f30700 1 --2- 172.21.15.139:0/3657601158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99500a0460 0x7f9950137b40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:39.716 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.712+0000 7f9957f30700 1 -- 172.21.15.139:0/3657601158 >> 172.21.15.139:0/3657601158 conn(0x7f9950060950 msgr2=0x7f99500a6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:39.716 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.712+0000 7f9957f30700 1 -- 172.21.15.139:0/3657601158 shutdown_connections 2020-02-12T14:12:39.716 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.712+0000 7f9957f30700 1 -- 172.21.15.139:0/3657601158 wait complete. 2020-02-12T14:12:39.725 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-12T14:12:39.830 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.828+0000 7f87577e2700 1 Processor -- start 2020-02-12T14:12:39.830 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.828+0000 7f87577e2700 1 -- start start 2020-02-12T14:12:39.833 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.829+0000 7f87577e2700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f87500a3f40 0x7f8750134df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:39.833 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.829+0000 7f87577e2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8750135250 0x7f87500a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:39.833 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.829+0000 7f87577e2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87501359e0 con 0x7f87500a21f0 2020-02-12T14:12:39.834 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.829+0000 7f87577e2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8750135c80 con 0x7f8750135250 2020-02-12T14:12:39.834 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.829+0000 7f87577e2700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87500a18f0 con 0x7f87500a3f40 2020-02-12T14:12:39.834 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.829+0000 7f875557e700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f87500a3f40 0x7f8750134df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:39.834 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.829+0000 7f875557e700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f87500a3f40 0x7f8750134df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46588/0 (socket says 172.21.15.139:46588) 2020-02-12T14:12:39.834 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.829+0000 7f875557e700 1 -- 172.21.15.139:0/253759604 learned_addr learned my addr 172.21.15.139:0/253759604 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:39.834 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.829+0000 7f875557e700 1 -- 172.21.15.139:0/253759604 >> v2:172.21.15.72:3300/0 conn(0x7f8750135250 msgr2=0x7f87500a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:39.834 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.829+0000 7f8754d7d700 1 --2- 172.21.15.139:0/253759604 >> v2:172.21.15.72:3300/0 conn(0x7f8750135250 0x7f87500a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:39.835 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.829+0000 7f875557e700 1 --2- 172.21.15.139:0/253759604 >> v2:172.21.15.72:3300/0 conn(0x7f8750135250 0x7f87500a1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:39.835 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.829+0000 7f875557e700 1 -- 172.21.15.139:0/253759604 >> v1:172.21.15.72:6789/0 conn(0x7f87500a21f0 legacy=0x7f8750138340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:39.835 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.829+0000 7f875557e700 1 -- 172.21.15.139:0/253759604 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87501356e0 con 0x7f87500a3f40 2020-02-12T14:12:39.835 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.829+0000 7f875557e700 1 --2- 172.21.15.139:0/253759604 >> v2:172.21.15.139:3300/0 conn(0x7f87500a3f40 0x7f8750134df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8750060f00 tx=0x7f8740007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.835 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.829+0000 7f875557e700 1 --2- 172.21.15.139:0/253759604 >> v2:172.21.15.139:3300/0 conn(0x7f87500a3f40 0x7f8750134df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8750060f00 tx=0x7f8740007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.835 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.829+0000 7f875557e700 1 --2- 172.21.15.139:0/253759604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87500a3f40 0x7f8750134df0 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f8750060f00 tx=0x7f8740007a40).ready entity=mon.1 client_cookie=cb575353f6e57359 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:39.835 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.829+0000 7f875557e700 1 --2- 172.21.15.139:0/253759604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87500a3f40 0x7f8750134df0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f8750060f00 tx=0x7f8740007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.836 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.829+0000 7f875557e700 1 --2- 172.21.15.139:0/253759604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87500a3f40 0x7f8750134df0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f8750060f00 tx=0x7f8740007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.836 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.829+0000 7f873ffff700 1 -- 172.21.15.139:0/253759604 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87400116e0 con 0x7f87500a3f40 2020-02-12T14:12:39.836 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.829+0000 7f875557e700 1 --2- 172.21.15.139:0/253759604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87500a3f40 0x7f8750134df0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f8750060f00 tx=0x7f8740007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.836 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.829+0000 7f873ffff700 1 -- 172.21.15.139:0/253759604 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8740011840 con 0x7f87500a3f40 2020-02-12T14:12:39.836 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.829+0000 7f873ffff700 1 -- 172.21.15.139:0/253759604 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8740011c20 con 0x7f87500a3f40 2020-02-12T14:12:39.836 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.829+0000 7f87577e2700 1 -- 172.21.15.139:0/253759604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87500a3f40 msgr2=0x7f8750134df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:39.836 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.829+0000 7f87577e2700 1 --2- 172.21.15.139:0/253759604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87500a3f40 0x7f8750134df0 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f8750060f00 tx=0x7f8740007a40).stop 2020-02-12T14:12:39.836 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.830+0000 7f87577e2700 1 -- 172.21.15.139:0/253759604 shutdown_connections 2020-02-12T14:12:39.837 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.830+0000 7f87577e2700 1 --2- 172.21.15.139:0/253759604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87500a3f40 0x7f8750134df0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:39.837 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.830+0000 7f87577e2700 1 --2- 172.21.15.139:0/253759604 >> v2:172.21.15.72:3300/0 conn(0x7f8750135250 0x7f87500a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:39.837 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.830+0000 7f87577e2700 1 -- 172.21.15.139:0/253759604 >> 172.21.15.139:0/253759604 conn(0x7f8750060950 msgr2=0x7f875009d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:39.837 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.830+0000 7f87577e2700 1 -- 172.21.15.139:0/253759604 shutdown_connections 2020-02-12T14:12:39.837 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.830+0000 7f87577e2700 1 -- 172.21.15.139:0/253759604 wait complete. 2020-02-12T14:12:39.837 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.831+0000 7f87577e2700 1 Processor -- start 2020-02-12T14:12:39.837 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.831+0000 7f87577e2700 1 -- start start 2020-02-12T14:12:39.841 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.831+0000 7f87577e2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87500a3f40 0x7f87501468d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:39.842 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.831+0000 7f87577e2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f875012dd20 con 0x7f87500a21f0 2020-02-12T14:12:39.842 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.831+0000 7f87577e2700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f875012dfc0 con 0x7f8750135250 2020-02-12T14:12:39.842 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.831+0000 7f87577e2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f875012db30 con 0x7f87500a3f40 2020-02-12T14:12:39.842 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.831+0000 7f8755d7f700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f8750135250 0x7f875014dc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35232/0 (socket says 172.21.15.139:35232) 2020-02-12T14:12:39.842 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.831+0000 7f8755d7f700 1 -- 172.21.15.139:0/2995698707 learned_addr learned my addr 172.21.15.139:0/2995698707 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:39.842 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f873e7fc700 1 -- 172.21.15.139:0/2995698707 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747815974 0 0) 0x7f875012dfc0 con 0x7f8750135250 2020-02-12T14:12:39.842 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f873e7fc700 1 -- 172.21.15.139:0/2995698707 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8730002fe0 con 0x7f8750135250 2020-02-12T14:12:39.843 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f8754d7d700 1 --2- 172.21.15.139:0/2995698707 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87500a3f40 0x7f87501468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:39.843 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f873e7fc700 1 -- 172.21.15.139:0/2995698707 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3503170874 0 0) 0x7f8730002fe0 con 0x7f8750135250 2020-02-12T14:12:39.843 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f873e7fc700 1 -- 172.21.15.139:0/2995698707 --> v1:172.21.15.139:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f875012dfc0 con 0x7f8750135250 2020-02-12T14:12:39.843 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f873e7fc700 1 -- 172.21.15.139:0/2995698707 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7f8748002ca0 con 0x7f8750135250 2020-02-12T14:12:39.843 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f873e7fc700 1 -- 172.21.15.139:0/2995698707 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87500a3f40 msgr2=0x7f87501468d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:39.843 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f873e7fc700 1 --2- 172.21.15.139:0/2995698707 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87500a3f40 0x7f87501468d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:39.843 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f873e7fc700 1 -- 172.21.15.139:0/2995698707 >> v1:172.21.15.139:6789/0 conn(0x7f8750135250 legacy=0x7f875014dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:39.844 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f873e7fc700 1 -- 172.21.15.139:0/2995698707 >> v1:172.21.15.72:6789/0 conn(0x7f87500a21f0 legacy=0x7f87501267c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:39.844 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f873e7fc700 1 --2- 172.21.15.139:0/2995698707 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87300049b0 0x7f8730004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:39.844 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f873e7fc700 1 --2- 172.21.15.139:0/2995698707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8730005260 0x7f8730003960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:39.844 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f873e7fc700 1 --2- 172.21.15.139:0/2995698707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8730003ed0 0x7f8730004350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:39.844 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f873e7fc700 1 -- 172.21.15.139:0/2995698707 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873000b780 con 0x7f8730003ed0 2020-02-12T14:12:39.844 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f873e7fc700 1 -- 172.21.15.139:0/2995698707 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873000b8f0 con 0x7f8730005260 2020-02-12T14:12:39.844 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f873e7fc700 1 -- 172.21.15.139:0/2995698707 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873000bab0 con 0x7f87300049b0 2020-02-12T14:12:39.845 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f8754d7d700 1 --2- 172.21.15.139:0/2995698707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8730005260 0x7f8730003960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:39.845 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f875557e700 1 --2- 172.21.15.139:0/2995698707 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87300049b0 0x7f8730004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:39.845 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f8755d7f700 1 --2- 172.21.15.139:0/2995698707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8730003ed0 0x7f8730004350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:39.845 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f8754d7d700 1 -- 172.21.15.139:0/2995698707 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87300049b0 msgr2=0x7f8730004d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:39.845 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f8754d7d700 1 --2- 172.21.15.139:0/2995698707 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87300049b0 0x7f8730004d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:39.845 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f8754d7d700 1 -- 172.21.15.139:0/2995698707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8730003ed0 msgr2=0x7f8730004350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:39.845 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f8754d7d700 1 --2- 172.21.15.139:0/2995698707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8730003ed0 0x7f8730004350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:39.846 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f8754d7d700 1 -- 172.21.15.139:0/2995698707 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875012ed20 con 0x7f8730005260 2020-02-12T14:12:39.846 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f87577e2700 1 -- 172.21.15.139:0/2995698707 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f875005ed50 con 0x7f8730005260 2020-02-12T14:12:39.846 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f8754d7d700 1 --2- 172.21.15.139:0/2995698707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8730005260 0x7f8730003960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f874c002f30 tx=0x7f874c010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.846 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.832+0000 7f8754d7d700 1 --2- 172.21.15.139:0/2995698707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8730005260 0x7f8730003960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f874c002f30 tx=0x7f874c010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.846 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.833+0000 7f8754d7d700 1 --2- 172.21.15.139:0/2995698707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8730005260 0x7f8730003960 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f874c002f30 tx=0x7f874c010a50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:39.846 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.833+0000 7f87577e2700 1 -- 172.21.15.139:0/2995698707 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8750126ed0 con 0x7f8730005260 2020-02-12T14:12:39.846 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.833+0000 7f8754d7d700 1 --2- 172.21.15.139:0/2995698707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8730005260 0x7f8730003960 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f874c002f30 tx=0x7f874c010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.846 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.833+0000 7f873e7fc700 1 -- 172.21.15.139:0/2995698707 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f874c005aa0 con 0x7f8730005260 2020-02-12T14:12:39.847 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.833+0000 7f8754d7d700 1 --2- 172.21.15.139:0/2995698707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8730005260 0x7f8730003960 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f874c002f30 tx=0x7f874c010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.847 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.833+0000 7f8754d7d700 1 --2- 172.21.15.139:0/2995698707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8730005260 0x7f8730003960 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f874c002f30 tx=0x7f874c010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.847 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.833+0000 7f873e7fc700 1 -- 172.21.15.139:0/2995698707 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874c005c00 con 0x7f8730005260 2020-02-12T14:12:39.847 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.833+0000 7f873e7fc700 1 -- 172.21.15.139:0/2995698707 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f874c012560 con 0x7f8730005260 2020-02-12T14:12:39.847 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.833+0000 7f8754d7d700 1 --2- 172.21.15.139:0/2995698707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8730005260 0x7f8730003960 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f874c002f30 tx=0x7f874c010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.847 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.833+0000 7f873e7fc700 1 -- 172.21.15.139:0/2995698707 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f874c0126c0 con 0x7f8730005260 2020-02-12T14:12:39.847 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.833+0000 7f8754d7d700 1 --2- 172.21.15.139:0/2995698707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8730005260 0x7f8730003960 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f874c002f30 tx=0x7f874c010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.848 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.834+0000 7f87577e2700 1 -- 172.21.15.139:0/2995698707 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f875012e750 con 0x7f8730005260 2020-02-12T14:12:39.848 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.834+0000 7f873e7fc700 1 --2- 172.21.15.139:0/2995698707 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f8730042580 0x7f8730044a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:39.848 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.834+0000 7f873e7fc700 1 -- 172.21.15.139:0/2995698707 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f874c049810 con 0x7f8730005260 2020-02-12T14:12:39.848 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.834+0000 7f875557e700 1 --2- 172.21.15.139:0/2995698707 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f8730042580 0x7f8730044a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:39.848 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.834+0000 7f875557e700 1 --2- 172.21.15.139:0/2995698707 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f8730042580 0x7f8730044a40 crc :-1 s=READY pgs=45 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:39.848 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.837+0000 7f8754d7d700 1 --2- 172.21.15.139:0/2995698707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8730005260 0x7f8730003960 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f874c002f30 tx=0x7f874c010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.848 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.837+0000 7f873e7fc700 1 -- 172.21.15.139:0/2995698707 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f874c02ef00 con 0x7f8730005260 2020-02-12T14:12:39.974 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.972+0000 7f87577e2700 1 -- 172.21.15.139:0/2995698707 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f875012e150 con 0x7f8730005260 2020-02-12T14:12:39.975 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.973+0000 7f8754d7d700 1 --2- 172.21.15.139:0/2995698707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8730005260 0x7f8730003960 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f874c002f30 tx=0x7f874c010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:39.975 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.973+0000 7f873e7fc700 1 -- 172.21.15.139:0/2995698707 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14933 (secure 0 0 0) 0x7f874c031a10 con 0x7f8730005260 2020-02-12T14:12:39.976 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:12:39.976 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":23,"fsid":"dacc9a6c-9e88-46ac-940b-c4a329dbffec","created":"2020-02-12T14:12:18.258232+0000","modified":"2020-02-12T14:12:39.447885+0000","last_up_change":"2020-02-12T14:12:27.050924+0000","last_in_change":"2020-02-12T14:12:27.050924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-12T14:12:31.091380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-02-12T14:12:34.160095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-02-12T14:12:37.119732+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffc0664d-9b93-45a4-a454-7655ee26d582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":22147},{"type":"v1","addr":"172.21.15.139:6803","nonce":22147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":22147},{"type":"v1","addr":"172.21.15.139:6805","nonce":22147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":22147},{"type":"v1","addr":"172.21.15.139:6809","nonce":22147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":22147},{"type":"v1","addr":"172.21.15.139:6807","nonce":22147}]},"public_addr":"172.21.15.139:6803/22147","cluster_addr":"172.21.15.139:6805/22147","heartbeat_back_addr":"172.21.15.139:6809/22147","heartbeat_front_addr":"172.21.15.139:6807/22147","state":["exists","up"]},{"osd":1,"uuid":"f66da6bc-43b3-4846-85f9-a25e3fe95216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":22148},{"type":"v1","addr":"172.21.15.139:6811","nonce":22148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":22148},{"type":"v1","addr":"172.21.15.139:6813","nonce":22148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6819","nonce":22148},{"type":"v1","addr":"172.21.15.139:6821","nonce":22148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6815","nonce":22148},{"type":"v1","addr":"172.21.15.139:6817","nonce":22148}]},"public_addr":"172.21.15.139:6811/22148","cluster_addr":"172.21.15.139:6813/22148","heartbeat_back_addr":"172.21.15.139:6821/22148","heartbeat_front_addr":"172.21.15.139:6817/22148","state":["exists","up"]},{"osd":2,"uuid":"c35fb293-3e16-41e8-85f3-768e11e55b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":22149},{"type":"v1","addr":"172.21.15.139:6827","nonce":22149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":22149},{"type":"v1","addr":"172.21.15.139:6829","nonce":22149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":22149},{"type":"v1","addr":"172.21.15.139:6833","nonce":22149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":22149},{"type":"v1","addr":"172.21.15.139:6831","nonce":22149}]},"public_addr":"172.21.15.139:6827/22149","cluster_addr":"172.21.15.139:6829/22149","heartbeat_back_addr":"172.21.15.139:6833/22149","heartbeat_front_addr":"172.21.15.139:6831/22149","state":["exists","up"]},{"osd":3,"uuid":"bc8b2c0d-e3dd-48cb-883e-6ea965aee923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":22150},{"type":"v1","addr":"172.21.15.139:6816","nonce":22150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":22150},{"type":"v1","addr":"172.21.15.139:6820","nonce":22150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":22150},{"type":"v1","addr":"172.21.15.139:6825","nonce":22150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":22150},{"type":"v1","addr":"172.21.15.139:6823","nonce":22150}]},"public_addr":"172.21.15.139:6816/22150","cluster_addr":"172.21.15.139:6820/22150","heartbeat_back_addr":"172.21.15.139:6825/22150","heartbeat_front_addr":"172.21.15.139:6823/22150","state":["exists","up"]},{"osd":4,"uuid":"aadfc406-0c40-4b6b-9e19-c92b2f40264a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":21598},{"type":"v1","addr":"172.21.15.72:6801","nonce":21598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":21598},{"type":"v1","addr":"172.21.15.72:6803","nonce":21598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":21598},{"type":"v1","addr":"172.21.15.72:6807","nonce":21598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":21598},{"type":"v1","addr":"172.21.15.72:6805","nonce":21598}]},"public_addr":"172.21.15.72:6801/21598","cluster_addr":"172.21.15.72:6803/21598","heartbeat_back_addr":"172.21.15.72:6807/21598","heartbeat_front_addr":"172.21.15.72:6805/21598","state":["exists","up"]},{"osd":5,"uuid":"3296dc8e-9322-4430-abd2-7672da5b7acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":21599},{"type":"v1","addr":"172.21.15.72:6810","nonce":21599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":21599},{"type":"v1","addr":"172.21.15.72:6815","nonce":21599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":21599},{"type":"v1","addr":"172.21.15.72:6823","nonce":21599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":21599},{"type":"v1","addr":"172.21.15.72:6820","nonce":21599}]},"public_addr":"172.21.15.72:6810/21599","cluster_addr":"172.21.15.72:6815/21599","heartbeat_back_addr":"172.21.15.72:6823/21599","heartbeat_front_addr":"172.21.15.72:6820/21599","state":["exists","up"]},{"osd":6,"uuid":"7c39cf20-a3a8-4d56-8577-f4102b302a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":21601},{"type":"v1","addr":"172.21.15.72:6811","nonce":21601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":21601},{"type":"v1","addr":"172.21.15.72:6814","nonce":21601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":21601},{"type":"v1","addr":"172.21.15.72:6821","nonce":21601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":21601},{"type":"v1","addr":"172.21.15.72:6818","nonce":21601}]},"public_addr":"172.21.15.72:6811/21601","cluster_addr":"172.21.15.72:6814/21601","heartbeat_back_addr":"172.21.15.72:6821/21601","heartbeat_front_addr":"172.21.15.72:6818/21601","state":["exists","up"]},{"osd":7,"uuid":"f452adff-8432-47e9-a5f1-9fd7e2a04a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":21600},{"type":"v1","addr":"172.21.15.72:6825","nonce":21600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":21600},{"type":"v1","addr":"172.21.15.72:6827","nonce":21600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":21600},{"type":"v1","addr":"172.21.15.72:6831","nonce":21600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":21600},{"type":"v1","addr":"172.21.15.72:6829","nonce":21600}]},"public_addr":"172.21.15.72:6825/21600","cluster_addr":"172.21.15.72:6827/21600","heartbeat_back_addr":"172.21.15.72:6831/21600","heartbeat_front_addr":"172.21.15.72:6829/21600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.259782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.267019+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.315501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.326256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.335328+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.284130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.083179+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.351445+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-12T14:12:39.977 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.974+0000 7f87577e2700 1 -- 172.21.15.139:0/2995698707 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f8730042580 msgr2=0x7f8730044a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:39.977 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.974+0000 7f87577e2700 1 --2- 172.21.15.139:0/2995698707 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f8730042580 0x7f8730044a40 crc :-1 s=READY pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:39.977 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.974+0000 7f87577e2700 1 -- 172.21.15.139:0/2995698707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8730005260 msgr2=0x7f8730003960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:39.977 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.974+0000 7f87577e2700 1 --2- 172.21.15.139:0/2995698707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8730005260 0x7f8730003960 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f874c002f30 tx=0x7f874c010a50).stop 2020-02-12T14:12:39.977 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.974+0000 7f8755d7f700 1 -- 172.21.15.139:0/2995698707 reap_dead start 2020-02-12T14:12:39.977 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.974+0000 7f87577e2700 1 -- 172.21.15.139:0/2995698707 shutdown_connections 2020-02-12T14:12:39.978 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.974+0000 7f87577e2700 1 -- 172.21.15.139:0/2995698707 >> 172.21.15.139:0/2995698707 conn(0x7f8750060950 msgr2=0x7f87500a9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:39.978 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.974+0000 7f87577e2700 1 -- 172.21.15.139:0/2995698707 shutdown_connections 2020-02-12T14:12:39.978 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:39.974+0000 7f87577e2700 1 -- 172.21.15.139:0/2995698707 wait complete. 2020-02-12T14:12:39.987 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-02-12T14:12:40.095 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.093+0000 7f672959c700 1 Processor -- start 2020-02-12T14:12:40.095 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.093+0000 7f672959c700 1 -- start start 2020-02-12T14:12:40.101 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.094+0000 7f672959c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6724135500 0x7f67240a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:40.101 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.094+0000 7f672959c700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f67240a21f0 0x7f672412e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:40.101 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.094+0000 7f672959c700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67241359e0 con 0x7f67240a3f40 2020-02-12T14:12:40.101 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.094+0000 7f672959c700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6724135c80 con 0x7f67240a21f0 2020-02-12T14:12:40.102 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.094+0000 7f672959c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67240a18f0 con 0x7f6724135500 2020-02-12T14:12:40.102 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.094+0000 7f67237fe700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f67240a21f0 0x7f672412e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:40.102 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.094+0000 7f6722ffd700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f67240a3f40 0x7f6724134df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35244/0 (socket says 172.21.15.139:35244) 2020-02-12T14:12:40.102 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.094+0000 7f6722ffd700 1 -- 172.21.15.139:0/2187964694 learned_addr learned my addr 172.21.15.139:0/2187964694 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:40.102 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.094+0000 7f671bfff700 1 --2- 172.21.15.139:0/2187964694 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6724135500 0x7f67240a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:40.102 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.094+0000 7f67237fe700 1 -- 172.21.15.139:0/2187964694 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6724135500 msgr2=0x7f67240a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:40.102 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.094+0000 7f67237fe700 1 --2- 172.21.15.139:0/2187964694 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6724135500 0x7f67240a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:40.103 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.094+0000 7f67237fe700 1 -- 172.21.15.139:0/2187964694 >> v1:172.21.15.139:6789/0 conn(0x7f67240a3f40 legacy=0x7f6724134df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:40.103 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.094+0000 7f67227fc700 1 -- 172.21.15.139:0/2187964694 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557999728 0 0) 0x7f67241359e0 con 0x7f67240a3f40 2020-02-12T14:12:40.103 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.094+0000 7f67237fe700 1 -- 172.21.15.139:0/2187964694 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67240a2680 con 0x7f67240a21f0 2020-02-12T14:12:40.103 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.094+0000 7f671bfff700 1 --2- 172.21.15.139:0/2187964694 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6724135500 0x7f67240a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-12T14:12:40.103 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.094+0000 7f67237fe700 1 --2- 172.21.15.139:0/2187964694 >> v2:172.21.15.139:3300/0 conn(0x7f67240a21f0 0x7f672412e6b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f671c0032b0 tx=0x7f671c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:40.103 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.094+0000 7f67237fe700 1 --2- 172.21.15.139:0/2187964694 >> v2:172.21.15.139:3300/0 conn(0x7f67240a21f0 0x7f672412e6b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f671c0032b0 tx=0x7f671c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:40.103 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.094+0000 7f67237fe700 1 --2- 172.21.15.139:0/2187964694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67240a21f0 0x7f672412e6b0 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f671c0032b0 tx=0x7f671c008c60).ready entity=mon.1 client_cookie=9d5cdfd403649c3d server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:40.104 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.094+0000 7f67237fe700 1 --2- 172.21.15.139:0/2187964694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67240a21f0 0x7f672412e6b0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f671c0032b0 tx=0x7f671c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:40.104 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.094+0000 7f67227fc700 1 -- 172.21.15.139:0/2187964694 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f671c00a160 con 0x7f67240a21f0 2020-02-12T14:12:40.104 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.094+0000 7f67237fe700 1 --2- 172.21.15.139:0/2187964694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67240a21f0 0x7f672412e6b0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f671c0032b0 tx=0x7f671c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:40.104 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.094+0000 7f67237fe700 1 --2- 172.21.15.139:0/2187964694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67240a21f0 0x7f672412e6b0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f671c0032b0 tx=0x7f671c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:40.104 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.094+0000 7f67227fc700 1 -- 172.21.15.139:0/2187964694 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671c00a2c0 con 0x7f67240a21f0 2020-02-12T14:12:40.104 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.094+0000 7f67227fc700 1 -- 172.21.15.139:0/2187964694 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f671c00a660 con 0x7f67240a21f0 2020-02-12T14:12:40.104 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.094+0000 7f672959c700 1 -- 172.21.15.139:0/2187964694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67240a21f0 msgr2=0x7f672412e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:40.104 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.094+0000 7f672959c700 1 --2- 172.21.15.139:0/2187964694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67240a21f0 0x7f672412e6b0 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f671c0032b0 tx=0x7f671c008c60).stop 2020-02-12T14:12:40.105 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.095+0000 7f672959c700 1 -- 172.21.15.139:0/2187964694 shutdown_connections 2020-02-12T14:12:40.105 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.095+0000 7f672959c700 1 --2- 172.21.15.139:0/2187964694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67240a21f0 0x7f672412e6b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:40.105 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.095+0000 7f672959c700 1 --2- 172.21.15.139:0/2187964694 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6724135500 0x7f67240a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:40.105 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.095+0000 7f672959c700 1 -- 172.21.15.139:0/2187964694 >> 172.21.15.139:0/2187964694 conn(0x7f6724060950 msgr2=0x7f672409d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:40.105 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.095+0000 7f672959c700 1 -- 172.21.15.139:0/2187964694 shutdown_connections 2020-02-12T14:12:40.105 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.095+0000 7f672959c700 1 -- 172.21.15.139:0/2187964694 wait complete. 2020-02-12T14:12:40.105 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.096+0000 7f672959c700 1 Processor -- start 2020-02-12T14:12:40.106 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.096+0000 7f672959c700 1 -- start start 2020-02-12T14:12:40.106 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.096+0000 7f672959c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6724135500 0x7f6724148c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:40.106 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.096+0000 7f672959c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672412fee0 con 0x7f67240a21f0 2020-02-12T14:12:40.106 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.096+0000 7f672959c700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6724130180 con 0x7f67240a3f40 2020-02-12T14:12:40.106 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.096+0000 7f672959c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6724130420 con 0x7f6724135500 2020-02-12T14:12:40.106 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.096+0000 7f671bfff700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f67240a3f40 0x7f6724066630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35250/0 (socket says 172.21.15.139:35250) 2020-02-12T14:12:40.106 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.096+0000 7f671bfff700 1 -- 172.21.15.139:0/2683428435 learned_addr learned my addr 172.21.15.139:0/2683428435 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:40.107 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.097+0000 7f67237fe700 1 --2- 172.21.15.139:0/2683428435 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6724135500 0x7f6724148c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:40.107 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.097+0000 7f6720ff9700 1 -- 172.21.15.139:0/2683428435 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2130449858 0 0) 0x7f6724130180 con 0x7f67240a3f40 2020-02-12T14:12:40.107 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.097+0000 7f6720ff9700 1 -- 172.21.15.139:0/2683428435 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6708002fe0 con 0x7f67240a3f40 2020-02-12T14:12:40.107 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.097+0000 7f6720ff9700 1 -- 172.21.15.139:0/2683428435 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 668367802 0 0) 0x7f672412fee0 con 0x7f67240a21f0 2020-02-12T14:12:40.107 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.097+0000 7f6720ff9700 1 -- 172.21.15.139:0/2683428435 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6724130180 con 0x7f67240a21f0 2020-02-12T14:12:40.107 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.097+0000 7f6720ff9700 1 -- 172.21.15.139:0/2683428435 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2091136996 0 0) 0x7f6708002fe0 con 0x7f67240a3f40 2020-02-12T14:12:40.107 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.097+0000 7f67237fe700 1 -- 172.21.15.139:0/2683428435 >> v1:172.21.15.139:6789/0 conn(0x7f67240a3f40 legacy=0x7f6724066630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:40.107 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.097+0000 7f67237fe700 1 -- 172.21.15.139:0/2683428435 >> v1:172.21.15.72:6789/0 conn(0x7f67240a21f0 legacy=0x7f6724133210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:40.108 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.097+0000 7f67237fe700 1 -- 172.21.15.139:0/2683428435 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672412fc10 con 0x7f6724135500 2020-02-12T14:12:40.108 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.097+0000 7f67237fe700 1 --2- 172.21.15.139:0/2683428435 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6724135500 0x7f6724148c90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f670c001fd0 tx=0x7f67240a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:40.108 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.097+0000 7f67237fe700 1 --2- 172.21.15.139:0/2683428435 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6724135500 0x7f6724148c90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f670c001fd0 tx=0x7f67240a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:40.108 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.097+0000 7f67237fe700 1 --2- 172.21.15.139:0/2683428435 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6724135500 0x7f6724148c90 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7f670c001fd0 tx=0x7f67240a2810).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:40.108 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.097+0000 7f67237fe700 1 --2- 172.21.15.139:0/2683428435 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6724135500 0x7f6724148c90 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f670c001fd0 tx=0x7f67240a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:40.108 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.097+0000 7f6720ff9700 1 -- 172.21.15.139:0/2683428435 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f670c002710 con 0x7f6724135500 2020-02-12T14:12:40.108 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.097+0000 7f67237fe700 1 --2- 172.21.15.139:0/2683428435 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6724135500 0x7f6724148c90 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f670c001fd0 tx=0x7f67240a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:40.108 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.097+0000 7f6720ff9700 1 -- 172.21.15.139:0/2683428435 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671c005a40 con 0x7f6724135500 2020-02-12T14:12:40.109 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.097+0000 7f672959c700 1 -- 172.21.15.139:0/2683428435 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6724066d40 con 0x7f6724135500 2020-02-12T14:12:40.109 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.097+0000 7f67237fe700 1 --2- 172.21.15.139:0/2683428435 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6724135500 0x7f6724148c90 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f670c001fd0 tx=0x7f67240a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:40.109 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.097+0000 7f6720ff9700 1 -- 172.21.15.139:0/2683428435 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f671c00aea0 con 0x7f6724135500 2020-02-12T14:12:40.109 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.097+0000 7f672959c700 1 -- 172.21.15.139:0/2683428435 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672405aaa0 con 0x7f6724135500 2020-02-12T14:12:40.109 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.098+0000 7f67237fe700 1 --2- 172.21.15.139:0/2683428435 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6724135500 0x7f6724148c90 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f670c001fd0 tx=0x7f67240a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:40.109 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.098+0000 7f672959c700 1 -- 172.21.15.139:0/2683428435 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f672405ad50 con 0x7f6724135500 2020-02-12T14:12:40.109 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.098+0000 7f6720ff9700 1 -- 172.21.15.139:0/2683428435 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f671c007150 con 0x7f6724135500 2020-02-12T14:12:40.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.098+0000 7f67237fe700 1 --2- 172.21.15.139:0/2683428435 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6724135500 0x7f6724148c90 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f670c001fd0 tx=0x7f67240a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:40.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.098+0000 7f6720ff9700 1 --2- 172.21.15.139:0/2683428435 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f670803a020 0x7f670803c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:40.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.098+0000 7f6720ff9700 1 -- 172.21.15.139:0/2683428435 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f671c04a190 con 0x7f6724135500 2020-02-12T14:12:40.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.098+0000 7f6722ffd700 1 --2- 172.21.15.139:0/2683428435 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f670803a020 0x7f670803c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:40.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.099+0000 7f6722ffd700 1 --2- 172.21.15.139:0/2683428435 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f670803a020 0x7f670803c4e0 crc :-1 s=READY pgs=46 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:40.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.102+0000 7f67237fe700 1 --2- 172.21.15.139:0/2683428435 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6724135500 0x7f6724148c90 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f670c001fd0 tx=0x7f67240a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:40.111 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.102+0000 7f6720ff9700 1 -- 172.21.15.139:0/2683428435 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f671c02f860 con 0x7f6724135500 2020-02-12T14:12:40.285 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:40.283+0000 7f672959c700 1 -- 172.21.15.139:0/2683428435 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6724067e20 con 0x7f6724135500 2020-02-12T14:12:40.472 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:12:40.475 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:12:41.137 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.135+0000 7f67237fe700 1 --2- 172.21.15.139:0/2683428435 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6724135500 0x7f6724148c90 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f670c001fd0 tx=0x7f67240a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.138 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.135+0000 7f6720ff9700 1 -- 172.21.15.139:0/2683428435 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v3) v1 ==== 118+0+0 (secure 0 0 0) 0x7f671c032370 con 0x7f6724135500 2020-02-12T14:12:41.139 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.137+0000 7f672959c700 1 -- 172.21.15.139:0/2683428435 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f670803a020 msgr2=0x7f670803c4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:41.139 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.137+0000 7f672959c700 1 --2- 172.21.15.139:0/2683428435 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f670803a020 0x7f670803c4e0 crc :-1 s=READY pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:41.139 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.137+0000 7f672959c700 1 -- 172.21.15.139:0/2683428435 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6724135500 msgr2=0x7f6724148c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:41.139 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.137+0000 7f672959c700 1 --2- 172.21.15.139:0/2683428435 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6724135500 0x7f6724148c90 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7f670c001fd0 tx=0x7f67240a2810).stop 2020-02-12T14:12:41.140 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.137+0000 7f672959c700 1 -- 172.21.15.139:0/2683428435 shutdown_connections 2020-02-12T14:12:41.140 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.137+0000 7f672959c700 1 --2- 172.21.15.139:0/2683428435 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f670803a020 0x7f670803c4e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:41.140 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.137+0000 7f672959c700 1 --2- 172.21.15.139:0/2683428435 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6724135500 0x7f6724148c90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:41.140 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.137+0000 7f672959c700 1 -- 172.21.15.139:0/2683428435 >> 172.21.15.139:0/2683428435 conn(0x7f6724060950 msgr2=0x7f67240a57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:41.140 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.137+0000 7f672959c700 1 -- 172.21.15.139:0/2683428435 shutdown_connections 2020-02-12T14:12:41.140 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.137+0000 7f672959c700 1 -- 172.21.15.139:0/2683428435 wait complete. 2020-02-12T14:12:41.151 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-02-12T14:12:41.258 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.256+0000 7fd83b5e2700 1 Processor -- start 2020-02-12T14:12:41.259 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.257+0000 7fd83b5e2700 1 -- start start 2020-02-12T14:12:41.261 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.257+0000 7fd83b5e2700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd834131cc0 0x7fd83413fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:41.261 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.257+0000 7fd83b5e2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8340a2fb0 con 0x7fd8340a7ac0 2020-02-12T14:12:41.261 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.257+0000 7fd83b5e2700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8340a60f0 con 0x7fd8340a5a50 2020-02-12T14:12:41.261 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.257+0000 7fd83b5e2700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8340a2360 con 0x7fd834131cc0 2020-02-12T14:12:41.262 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.257+0000 7fd839b7f700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd834131cc0 0x7fd83413fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:41.262 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.257+0000 7fd838b7d700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fd8340a5a50 0x7fd8341315b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35260/0 (socket says 172.21.15.139:35260) 2020-02-12T14:12:41.262 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.257+0000 7fd838b7d700 1 -- 172.21.15.139:0/1106863726 learned_addr learned my addr 172.21.15.139:0/1106863726 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:41.262 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.258+0000 7fd839b7f700 1 -- 172.21.15.139:0/1106863726 >> v1:172.21.15.139:6789/0 conn(0x7fd8340a5a50 legacy=0x7fd8341315b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:41.262 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.258+0000 7fd839b7f700 1 -- 172.21.15.139:0/1106863726 >> v1:172.21.15.72:6789/0 conn(0x7fd8340a7ac0 legacy=0x7fd8340a3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:41.262 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.258+0000 7fd823fff700 1 -- 172.21.15.139:0/1106863726 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 381429993 0 0) 0x7fd8340a60f0 con 0x7fd8340a5a50 2020-02-12T14:12:41.262 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.258+0000 7fd839b7f700 1 -- 172.21.15.139:0/1106863726 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8340a3680 con 0x7fd834131cc0 2020-02-12T14:12:41.262 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.258+0000 7fd839b7f700 1 --2- 172.21.15.139:0/1106863726 >> v2:172.21.15.139:3300/0 conn(0x7fd834131cc0 0x7fd83413fda0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd8340a3a00 tx=0x7fd82c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.263 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.258+0000 7fd839b7f700 1 --2- 172.21.15.139:0/1106863726 >> v2:172.21.15.139:3300/0 conn(0x7fd834131cc0 0x7fd83413fda0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd8340a3a00 tx=0x7fd82c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.263 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.258+0000 7fd839b7f700 1 --2- 172.21.15.139:0/1106863726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd834131cc0 0x7fd83413fda0 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7fd8340a3a00 tx=0x7fd82c008c60).ready entity=mon.1 client_cookie=c04c8aac41196f75 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:41.263 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.258+0000 7fd839b7f700 1 --2- 172.21.15.139:0/1106863726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd834131cc0 0x7fd83413fda0 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fd8340a3a00 tx=0x7fd82c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.263 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.258+0000 7fd823fff700 1 -- 172.21.15.139:0/1106863726 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd82c012e80 con 0x7fd834131cc0 2020-02-12T14:12:41.263 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.258+0000 7fd839b7f700 1 --2- 172.21.15.139:0/1106863726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd834131cc0 0x7fd83413fda0 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fd8340a3a00 tx=0x7fd82c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.263 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.258+0000 7fd823fff700 1 -- 172.21.15.139:0/1106863726 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c0132b0 con 0x7fd834131cc0 2020-02-12T14:12:41.263 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.258+0000 7fd839b7f700 1 --2- 172.21.15.139:0/1106863726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd834131cc0 0x7fd83413fda0 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fd8340a3a00 tx=0x7fd82c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.264 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.258+0000 7fd823fff700 1 -- 172.21.15.139:0/1106863726 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd82c013690 con 0x7fd834131cc0 2020-02-12T14:12:41.264 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.258+0000 7fd83b5e2700 1 -- 172.21.15.139:0/1106863726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd834131cc0 msgr2=0x7fd83413fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:41.264 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.258+0000 7fd83b5e2700 1 --2- 172.21.15.139:0/1106863726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd834131cc0 0x7fd83413fda0 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7fd8340a3a00 tx=0x7fd82c008c60).stop 2020-02-12T14:12:41.264 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.258+0000 7fd83b5e2700 1 -- 172.21.15.139:0/1106863726 shutdown_connections 2020-02-12T14:12:41.264 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.258+0000 7fd83b5e2700 1 --2- 172.21.15.139:0/1106863726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd834131cc0 0x7fd83413fda0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:41.264 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.258+0000 7fd83b5e2700 1 -- 172.21.15.139:0/1106863726 >> 172.21.15.139:0/1106863726 conn(0x7fd834060950 msgr2=0x7fd83409d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:41.264 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.259+0000 7fd83b5e2700 1 -- 172.21.15.139:0/1106863726 shutdown_connections 2020-02-12T14:12:41.264 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.259+0000 7fd83b5e2700 1 -- 172.21.15.139:0/1106863726 wait complete. 2020-02-12T14:12:41.267 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.259+0000 7fd83b5e2700 1 Processor -- start 2020-02-12T14:12:41.267 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.259+0000 7fd83b5e2700 1 -- start start 2020-02-12T14:12:41.267 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.260+0000 7fd83b5e2700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd8340a5a50 0x7fd834137090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:41.268 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.260+0000 7fd83b5e2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd834131cc0 0x7fd834066380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:41.268 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.260+0000 7fd83b5e2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8341374f0 con 0x7fd8340a7ac0 2020-02-12T14:12:41.268 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.260+0000 7fd83b5e2700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd834136690 con 0x7fd8340a5a50 2020-02-12T14:12:41.268 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.260+0000 7fd83b5e2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd834135cb0 con 0x7fd834131cc0 2020-02-12T14:12:41.268 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.260+0000 7fd83937e700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd8340a5a50 0x7fd834137090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:41.268 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.260+0000 7fd83937e700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd8340a5a50 0x7fd834137090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46626/0 (socket says 172.21.15.139:46626) 2020-02-12T14:12:41.268 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.260+0000 7fd83937e700 1 -- 172.21.15.139:0/1667720874 learned_addr learned my addr 172.21.15.139:0/1667720874 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:41.269 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.260+0000 7fd83937e700 1 -- 172.21.15.139:0/1667720874 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd834131cc0 msgr2=0x7fd834066380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:41.269 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.260+0000 7fd83937e700 1 --2- 172.21.15.139:0/1667720874 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd834131cc0 0x7fd834066380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:41.269 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.260+0000 7fd83937e700 1 -- 172.21.15.139:0/1667720874 >> v1:172.21.15.72:6789/0 conn(0x7fd8340a7ac0 legacy=0x7fd834145390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:41.269 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.260+0000 7fd83937e700 1 -- 172.21.15.139:0/1667720874 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd834135f50 con 0x7fd8340a5a50 2020-02-12T14:12:41.269 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.260+0000 7fd83937e700 1 --2- 172.21.15.139:0/1667720874 >> v2:172.21.15.139:3300/0 conn(0x7fd8340a5a50 0x7fd834137090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd8340a4ab0 tx=0x7fd824010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.269 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.260+0000 7fd83937e700 1 --2- 172.21.15.139:0/1667720874 >> v2:172.21.15.139:3300/0 conn(0x7fd8340a5a50 0x7fd834137090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd8340a4ab0 tx=0x7fd824010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.269 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.260+0000 7fd83937e700 1 --2- 172.21.15.139:0/1667720874 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8340a5a50 0x7fd834137090 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7fd8340a4ab0 tx=0x7fd824010a10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:41.269 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.260+0000 7fd83937e700 1 --2- 172.21.15.139:0/1667720874 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8340a5a50 0x7fd834137090 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fd8340a4ab0 tx=0x7fd824010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.270 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.260+0000 7fd8227fc700 1 -- 172.21.15.139:0/1667720874 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd824001ea0 con 0x7fd8340a5a50 2020-02-12T14:12:41.270 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.261+0000 7fd83937e700 1 --2- 172.21.15.139:0/1667720874 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8340a5a50 0x7fd834137090 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fd8340a4ab0 tx=0x7fd824010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.270 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.261+0000 7fd83937e700 1 --2- 172.21.15.139:0/1667720874 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8340a5a50 0x7fd834137090 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fd8340a4ab0 tx=0x7fd824010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.270 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.261+0000 7fd8227fc700 1 -- 172.21.15.139:0/1667720874 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82400cc20 con 0x7fd8340a5a50 2020-02-12T14:12:41.270 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.261+0000 7fd8227fc700 1 -- 172.21.15.139:0/1667720874 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd824012070 con 0x7fd8340a5a50 2020-02-12T14:12:41.270 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.261+0000 7fd83b5e2700 1 -- 172.21.15.139:0/1667720874 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8341361f0 con 0x7fd8340a5a50 2020-02-12T14:12:41.270 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.261+0000 7fd83b5e2700 1 -- 172.21.15.139:0/1667720874 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd834145b20 con 0x7fd8340a5a50 2020-02-12T14:12:41.270 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.261+0000 7fd83937e700 1 --2- 172.21.15.139:0/1667720874 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8340a5a50 0x7fd834137090 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fd8340a4ab0 tx=0x7fd824010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.271 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.262+0000 7fd8227fc700 1 -- 172.21.15.139:0/1667720874 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fd8240064e0 con 0x7fd8340a5a50 2020-02-12T14:12:41.271 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.262+0000 7fd83937e700 1 --2- 172.21.15.139:0/1667720874 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8340a5a50 0x7fd834137090 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fd8340a4ab0 tx=0x7fd824010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.271 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.262+0000 7fd8227fc700 1 --2- 172.21.15.139:0/1667720874 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fd814039c70 0x7fd81403c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:41.271 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.262+0000 7fd8227fc700 1 -- 172.21.15.139:0/1667720874 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fd824049380 con 0x7fd8340a5a50 2020-02-12T14:12:41.271 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.262+0000 7fd838b7d700 1 --2- 172.21.15.139:0/1667720874 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fd814039c70 0x7fd81403c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:41.271 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.262+0000 7fd83b5e2700 1 -- 172.21.15.139:0/1667720874 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8341374f0 con 0x7fd8340a5a50 2020-02-12T14:12:41.271 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.262+0000 7fd838b7d700 1 --2- 172.21.15.139:0/1667720874 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fd814039c70 0x7fd81403c130 crc :-1 s=READY pgs=47 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:41.272 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.265+0000 7fd83937e700 1 --2- 172.21.15.139:0/1667720874 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8340a5a50 0x7fd834137090 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fd8340a4ab0 tx=0x7fd824010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.272 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.265+0000 7fd8227fc700 1 -- 172.21.15.139:0/1667720874 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fd8341374f0 con 0x7fd8340a5a50 2020-02-12T14:12:41.445 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.443+0000 7fd83b5e2700 1 -- 172.21.15.139:0/1667720874 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8341374f0 con 0x7fd8340a5a50 2020-02-12T14:12:41.446 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.443+0000 7fd83937e700 1 --2- 172.21.15.139:0/1667720874 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8340a5a50 0x7fd834137090 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fd8340a4ab0 tx=0x7fd824010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.446 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.443+0000 7fd8227fc700 1 -- 172.21.15.139:0/1667720874 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1420 (secure 0 0 0) 0x7fd8341374f0 con 0x7fd8340a5a50 2020-02-12T14:12:41.446 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:12:41.446 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":3,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":3,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-02-12T14:12:39.448075+0000","modified":"2020-02-12T14:12:41.131952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-02-12T14:12:41.447 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.444+0000 7fd83b5e2700 1 -- 172.21.15.139:0/1667720874 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fd814039c70 msgr2=0x7fd81403c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:41.448 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.445+0000 7fd83b5e2700 1 --2- 172.21.15.139:0/1667720874 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fd814039c70 0x7fd81403c130 crc :-1 s=READY pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:41.448 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.445+0000 7fd83b5e2700 1 -- 172.21.15.139:0/1667720874 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8340a5a50 msgr2=0x7fd834137090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:41.448 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.445+0000 7fd83b5e2700 1 --2- 172.21.15.139:0/1667720874 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8340a5a50 0x7fd834137090 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7fd8340a4ab0 tx=0x7fd824010a10).stop 2020-02-12T14:12:41.448 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.445+0000 7fd83b5e2700 1 -- 172.21.15.139:0/1667720874 shutdown_connections 2020-02-12T14:12:41.448 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.445+0000 7fd83b5e2700 1 --2- 172.21.15.139:0/1667720874 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd834131cc0 0x7fd834066380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:41.448 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.445+0000 7fd83b5e2700 1 --2- 172.21.15.139:0/1667720874 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fd814039c70 0x7fd81403c130 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:41.449 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.445+0000 7fd83b5e2700 1 --2- 172.21.15.139:0/1667720874 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8340a5a50 0x7fd834137090 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:41.449 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.445+0000 7fd83b5e2700 1 -- 172.21.15.139:0/1667720874 >> 172.21.15.139:0/1667720874 conn(0x7fd834060950 msgr2=0x7fd8340a6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:41.449 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.445+0000 7fd83b5e2700 1 -- 172.21.15.139:0/1667720874 shutdown_connections 2020-02-12T14:12:41.449 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.445+0000 7fd83b5e2700 1 -- 172.21.15.139:0/1667720874 wait complete. 2020-02-12T14:12:41.449 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 3 2020-02-12T14:12:41.457 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-12T14:12:41.561 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.559+0000 7f3cbc2ae700 1 Processor -- start 2020-02-12T14:12:41.562 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.559+0000 7f3cbc2ae700 1 -- start start 2020-02-12T14:12:41.564 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.560+0000 7f3cbc2ae700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3cb40a3f40 0x7f3cb4134df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:41.564 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.560+0000 7f3cbc2ae700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3cb40a24a0 0x7f3cb412e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:41.564 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.560+0000 7f3cbc2ae700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb41359e0 con 0x7f3cb4135250 2020-02-12T14:12:41.564 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.560+0000 7f3cbc2ae700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cb4135c80 con 0x7f3cb40a3f40 2020-02-12T14:12:41.565 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.560+0000 7f3cbc2ae700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb40a18f0 con 0x7f3cb40a24a0 2020-02-12T14:12:41.565 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.560+0000 7f3cba04a700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3cb40a3f40 0x7f3cb4134df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:41.565 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.560+0000 7f3cba04a700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3cb40a3f40 0x7f3cb4134df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46634/0 (socket says 172.21.15.139:46634) 2020-02-12T14:12:41.565 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.560+0000 7f3cba04a700 1 -- 172.21.15.139:0/3260032682 learned_addr learned my addr 172.21.15.139:0/3260032682 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:41.565 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.560+0000 7f3cba04a700 1 -- 172.21.15.139:0/3260032682 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3cb40a24a0 msgr2=0x7f3cb412e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:41.565 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.560+0000 7f3cba04a700 1 --2- 172.21.15.139:0/3260032682 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3cb40a24a0 0x7f3cb412e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:41.565 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.560+0000 7f3cba04a700 1 -- 172.21.15.139:0/3260032682 >> v1:172.21.15.72:6789/0 conn(0x7f3cb4135250 legacy=0x7f3cb40a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:41.566 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.560+0000 7f3cba04a700 1 -- 172.21.15.139:0/3260032682 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb41356e0 con 0x7f3cb40a3f40 2020-02-12T14:12:41.566 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.560+0000 7f3cba04a700 1 --2- 172.21.15.139:0/3260032682 >> v2:172.21.15.139:3300/0 conn(0x7f3cb40a3f40 0x7f3cb4134df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3cb4060f00 tx=0x7f3ca40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.566 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.560+0000 7f3cba04a700 1 --2- 172.21.15.139:0/3260032682 >> v2:172.21.15.139:3300/0 conn(0x7f3cb40a3f40 0x7f3cb4134df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3cb4060f00 tx=0x7f3ca40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.566 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.560+0000 7f3cba04a700 1 --2- 172.21.15.139:0/3260032682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cb40a3f40 0x7f3cb4134df0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f3cb4060f00 tx=0x7f3ca40088e0).ready entity=mon.1 client_cookie=c84e52e67b134815 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:41.566 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.561+0000 7f3cba04a700 1 --2- 172.21.15.139:0/3260032682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cb40a3f40 0x7f3cb4134df0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f3cb4060f00 tx=0x7f3ca40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.566 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.561+0000 7f3cb9048700 1 -- 172.21.15.139:0/3260032682 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ca4011720 con 0x7f3cb40a3f40 2020-02-12T14:12:41.566 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.561+0000 7f3cba04a700 1 --2- 172.21.15.139:0/3260032682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cb40a3f40 0x7f3cb4134df0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f3cb4060f00 tx=0x7f3ca40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.567 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.561+0000 7f3cba04a700 1 --2- 172.21.15.139:0/3260032682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cb40a3f40 0x7f3cb4134df0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f3cb4060f00 tx=0x7f3ca40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.567 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.561+0000 7f3cb9048700 1 -- 172.21.15.139:0/3260032682 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca4011880 con 0x7f3cb40a3f40 2020-02-12T14:12:41.567 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.561+0000 7f3cb9048700 1 -- 172.21.15.139:0/3260032682 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ca4011c20 con 0x7f3cb40a3f40 2020-02-12T14:12:41.567 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.561+0000 7f3cbc2ae700 1 -- 172.21.15.139:0/3260032682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cb40a3f40 msgr2=0x7f3cb4134df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:41.567 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.561+0000 7f3cbc2ae700 1 --2- 172.21.15.139:0/3260032682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cb40a3f40 0x7f3cb4134df0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f3cb4060f00 tx=0x7f3ca40088e0).stop 2020-02-12T14:12:41.567 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.561+0000 7f3cbc2ae700 1 -- 172.21.15.139:0/3260032682 shutdown_connections 2020-02-12T14:12:41.567 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.561+0000 7f3cbc2ae700 1 --2- 172.21.15.139:0/3260032682 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3cb40a24a0 0x7f3cb412e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:41.567 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.561+0000 7f3cbc2ae700 1 --2- 172.21.15.139:0/3260032682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cb40a3f40 0x7f3cb4134df0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:41.568 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.561+0000 7f3cbc2ae700 1 -- 172.21.15.139:0/3260032682 >> 172.21.15.139:0/3260032682 conn(0x7f3cb4060950 msgr2=0x7f3cb409d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:41.568 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.561+0000 7f3cbc2ae700 1 -- 172.21.15.139:0/3260032682 shutdown_connections 2020-02-12T14:12:41.568 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.561+0000 7f3cbc2ae700 1 -- 172.21.15.139:0/3260032682 wait complete. 2020-02-12T14:12:41.568 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.562+0000 7f3cbc2ae700 1 Processor -- start 2020-02-12T14:12:41.568 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.562+0000 7f3cbc2ae700 1 -- start start 2020-02-12T14:12:41.571 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.563+0000 7f3cbc2ae700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3cb40a3f40 0x7f3cb4130970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:41.571 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.563+0000 7f3cbc2ae700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3cb4135250 0x7f3cb412b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:41.571 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.563+0000 7f3cbc2ae700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb405b4f0 con 0x7f3cb40a24a0 2020-02-12T14:12:41.572 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.563+0000 7f3cbc2ae700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cb40671b0 con 0x7f3cb4135250 2020-02-12T14:12:41.572 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.563+0000 7f3cbc2ae700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb41323a0 con 0x7f3cb40a3f40 2020-02-12T14:12:41.572 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.563+0000 7f3cba84b700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3cb4135250 0x7f3cb412b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:41.572 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.563+0000 7f3cba84b700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3cb4135250 0x7f3cb412b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46644/0 (socket says 172.21.15.139:46644) 2020-02-12T14:12:41.572 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.563+0000 7f3cba84b700 1 -- 172.21.15.139:0/3577538840 learned_addr learned my addr 172.21.15.139:0/3577538840 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:41.572 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.563+0000 7f3cb9849700 1 --2- 172.21.15.139:0/3577538840 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3cb40a3f40 0x7f3cb4130970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:41.572 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.563+0000 7f3cba84b700 1 -- 172.21.15.139:0/3577538840 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3cb40a3f40 msgr2=0x7f3cb4130970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:41.573 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.563+0000 7f3cba84b700 1 --2- 172.21.15.139:0/3577538840 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3cb40a3f40 0x7f3cb4130970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:41.573 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.563+0000 7f3cba84b700 1 -- 172.21.15.139:0/3577538840 >> v1:172.21.15.72:6789/0 conn(0x7f3cb40a24a0 legacy=0x7f3cb4066aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:41.573 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.563+0000 7f3cba84b700 1 -- 172.21.15.139:0/3577538840 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb412faf0 con 0x7f3cb4135250 2020-02-12T14:12:41.573 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.563+0000 7f3cba84b700 1 --2- 172.21.15.139:0/3577538840 >> v2:172.21.15.139:3300/0 conn(0x7f3cb4135250 0x7f3cb412b6b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3cac0032b0 tx=0x7f3cac010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.573 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.563+0000 7f3cba84b700 1 --2- 172.21.15.139:0/3577538840 >> v2:172.21.15.139:3300/0 conn(0x7f3cb4135250 0x7f3cb412b6b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3cac0032b0 tx=0x7f3cac010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.573 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.563+0000 7f3cba84b700 1 --2- 172.21.15.139:0/3577538840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cb4135250 0x7f3cb412b6b0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f3cac0032b0 tx=0x7f3cac010ca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:41.573 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.563+0000 7f3cba84b700 1 --2- 172.21.15.139:0/3577538840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cb4135250 0x7f3cb412b6b0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f3cac0032b0 tx=0x7f3cac010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.574 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.563+0000 7f3cba84b700 1 --2- 172.21.15.139:0/3577538840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cb4135250 0x7f3cb412b6b0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f3cac0032b0 tx=0x7f3cac010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.574 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.563+0000 7f3cba84b700 1 --2- 172.21.15.139:0/3577538840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cb4135250 0x7f3cb412b6b0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f3cac0032b0 tx=0x7f3cac010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.574 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.563+0000 7f3ca37fe700 1 -- 172.21.15.139:0/3577538840 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3cac012530 con 0x7f3cb4135250 2020-02-12T14:12:41.574 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.563+0000 7f3ca37fe700 1 -- 172.21.15.139:0/3577538840 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cac012690 con 0x7f3cb4135250 2020-02-12T14:12:41.574 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.563+0000 7f3cbc2ae700 1 -- 172.21.15.139:0/3577538840 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb4132640 con 0x7f3cb4135250 2020-02-12T14:12:41.574 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.563+0000 7f3ca37fe700 1 -- 172.21.15.139:0/3577538840 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3cac012a70 con 0x7f3cb4135250 2020-02-12T14:12:41.574 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.563+0000 7f3cbc2ae700 1 -- 172.21.15.139:0/3577538840 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb409e200 con 0x7f3cb4135250 2020-02-12T14:12:41.574 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.564+0000 7f3cba84b700 1 --2- 172.21.15.139:0/3577538840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cb4135250 0x7f3cb412b6b0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f3cac0032b0 tx=0x7f3cac010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.575 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.564+0000 7f3ca37fe700 1 -- 172.21.15.139:0/3577538840 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f3cac012ce0 con 0x7f3cb4135250 2020-02-12T14:12:41.575 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.564+0000 7f3cba84b700 1 --2- 172.21.15.139:0/3577538840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cb4135250 0x7f3cb412b6b0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f3cac0032b0 tx=0x7f3cac010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.575 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.564+0000 7f3ca37fe700 1 --2- 172.21.15.139:0/3577538840 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f3c94039be0 0x7f3c9403c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:41.575 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.564+0000 7f3ca37fe700 1 -- 172.21.15.139:0/3577538840 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f3cac04a110 con 0x7f3cb4135250 2020-02-12T14:12:41.575 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.564+0000 7f3cba04a700 1 --2- 172.21.15.139:0/3577538840 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f3c94039be0 0x7f3c9403c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:41.575 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.564+0000 7f3cbc2ae700 1 -- 172.21.15.139:0/3577538840 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb4067e20 con 0x7f3cb4135250 2020-02-12T14:12:41.575 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.565+0000 7f3cba04a700 1 --2- 172.21.15.139:0/3577538840 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f3c94039be0 0x7f3c9403c0a0 crc :-1 s=READY pgs=48 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:41.576 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.568+0000 7f3cba84b700 1 --2- 172.21.15.139:0/3577538840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cb4135250 0x7f3cb412b6b0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f3cac0032b0 tx=0x7f3cac010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.576 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.568+0000 7f3ca37fe700 1 -- 172.21.15.139:0/3577538840 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f3cac02f7e0 con 0x7f3cb4135250 2020-02-12T14:12:41.705 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.703+0000 7f3cbc2ae700 1 -- 172.21.15.139:0/3577538840 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3cb4059fd0 con 0x7f3cb4135250 2020-02-12T14:12:41.706 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.704+0000 7f3cba84b700 1 --2- 172.21.15.139:0/3577538840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cb4135250 0x7f3cb412b6b0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f3cac0032b0 tx=0x7f3cac010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.706 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.704+0000 7f3ca37fe700 1 -- 172.21.15.139:0/3577538840 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14933 (secure 0 0 0) 0x7f3cac0322b0 con 0x7f3cb4135250 2020-02-12T14:12:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:12:41.707 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":23,"fsid":"dacc9a6c-9e88-46ac-940b-c4a329dbffec","created":"2020-02-12T14:12:18.258232+0000","modified":"2020-02-12T14:12:39.447885+0000","last_up_change":"2020-02-12T14:12:27.050924+0000","last_in_change":"2020-02-12T14:12:27.050924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-12T14:12:31.091380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-02-12T14:12:34.160095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-02-12T14:12:37.119732+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffc0664d-9b93-45a4-a454-7655ee26d582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":22147},{"type":"v1","addr":"172.21.15.139:6803","nonce":22147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":22147},{"type":"v1","addr":"172.21.15.139:6805","nonce":22147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":22147},{"type":"v1","addr":"172.21.15.139:6809","nonce":22147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":22147},{"type":"v1","addr":"172.21.15.139:6807","nonce":22147}]},"public_addr":"172.21.15.139:6803/22147","cluster_addr":"172.21.15.139:6805/22147","heartbeat_back_addr":"172.21.15.139:6809/22147","heartbeat_front_addr":"172.21.15.139:6807/22147","state":["exists","up"]},{"osd":1,"uuid":"f66da6bc-43b3-4846-85f9-a25e3fe95216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":22148},{"type":"v1","addr":"172.21.15.139:6811","nonce":22148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":22148},{"type":"v1","addr":"172.21.15.139:6813","nonce":22148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6819","nonce":22148},{"type":"v1","addr":"172.21.15.139:6821","nonce":22148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6815","nonce":22148},{"type":"v1","addr":"172.21.15.139:6817","nonce":22148}]},"public_addr":"172.21.15.139:6811/22148","cluster_addr":"172.21.15.139:6813/22148","heartbeat_back_addr":"172.21.15.139:6821/22148","heartbeat_front_addr":"172.21.15.139:6817/22148","state":["exists","up"]},{"osd":2,"uuid":"c35fb293-3e16-41e8-85f3-768e11e55b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":22149},{"type":"v1","addr":"172.21.15.139:6827","nonce":22149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":22149},{"type":"v1","addr":"172.21.15.139:6829","nonce":22149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":22149},{"type":"v1","addr":"172.21.15.139:6833","nonce":22149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":22149},{"type":"v1","addr":"172.21.15.139:6831","nonce":22149}]},"public_addr":"172.21.15.139:6827/22149","cluster_addr":"172.21.15.139:6829/22149","heartbeat_back_addr":"172.21.15.139:6833/22149","heartbeat_front_addr":"172.21.15.139:6831/22149","state":["exists","up"]},{"osd":3,"uuid":"bc8b2c0d-e3dd-48cb-883e-6ea965aee923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":22150},{"type":"v1","addr":"172.21.15.139:6816","nonce":22150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":22150},{"type":"v1","addr":"172.21.15.139:6820","nonce":22150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":22150},{"type":"v1","addr":"172.21.15.139:6825","nonce":22150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":22150},{"type":"v1","addr":"172.21.15.139:6823","nonce":22150}]},"public_addr":"172.21.15.139:6816/22150","cluster_addr":"172.21.15.139:6820/22150","heartbeat_back_addr":"172.21.15.139:6825/22150","heartbeat_front_addr":"172.21.15.139:6823/22150","state":["exists","up"]},{"osd":4,"uuid":"aadfc406-0c40-4b6b-9e19-c92b2f40264a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":21598},{"type":"v1","addr":"172.21.15.72:6801","nonce":21598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":21598},{"type":"v1","addr":"172.21.15.72:6803","nonce":21598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":21598},{"type":"v1","addr":"172.21.15.72:6807","nonce":21598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":21598},{"type":"v1","addr":"172.21.15.72:6805","nonce":21598}]},"public_addr":"172.21.15.72:6801/21598","cluster_addr":"172.21.15.72:6803/21598","heartbeat_back_addr":"172.21.15.72:6807/21598","heartbeat_front_addr":"172.21.15.72:6805/21598","state":["exists","up"]},{"osd":5,"uuid":"3296dc8e-9322-4430-abd2-7672da5b7acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":21599},{"type":"v1","addr":"172.21.15.72:6810","nonce":21599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":21599},{"type":"v1","addr":"172.21.15.72:6815","nonce":21599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":21599},{"type":"v1","addr":"172.21.15.72:6823","nonce":21599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":21599},{"type":"v1","addr":"172.21.15.72:6820","nonce":21599}]},"public_addr":"172.21.15.72:6810/21599","cluster_addr":"172.21.15.72:6815/21599","heartbeat_back_addr":"172.21.15.72:6823/21599","heartbeat_front_addr":"172.21.15.72:6820/21599","state":["exists","up"]},{"osd":6,"uuid":"7c39cf20-a3a8-4d56-8577-f4102b302a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":21601},{"type":"v1","addr":"172.21.15.72:6811","nonce":21601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":21601},{"type":"v1","addr":"172.21.15.72:6814","nonce":21601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":21601},{"type":"v1","addr":"172.21.15.72:6821","nonce":21601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":21601},{"type":"v1","addr":"172.21.15.72:6818","nonce":21601}]},"public_addr":"172.21.15.72:6811/21601","cluster_addr":"172.21.15.72:6814/21601","heartbeat_back_addr":"172.21.15.72:6821/21601","heartbeat_front_addr":"172.21.15.72:6818/21601","state":["exists","up"]},{"osd":7,"uuid":"f452adff-8432-47e9-a5f1-9fd7e2a04a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":21600},{"type":"v1","addr":"172.21.15.72:6825","nonce":21600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":21600},{"type":"v1","addr":"172.21.15.72:6827","nonce":21600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":21600},{"type":"v1","addr":"172.21.15.72:6831","nonce":21600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":21600},{"type":"v1","addr":"172.21.15.72:6829","nonce":21600}]},"public_addr":"172.21.15.72:6825/21600","cluster_addr":"172.21.15.72:6827/21600","heartbeat_back_addr":"172.21.15.72:6831/21600","heartbeat_front_addr":"172.21.15.72:6829/21600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.259782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.267019+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.315501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.326256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.335328+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.284130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.083179+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.351445+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-12T14:12:41.708 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.705+0000 7f3cbc2ae700 1 -- 172.21.15.139:0/3577538840 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f3c94039be0 msgr2=0x7f3c9403c0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:41.708 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.705+0000 7f3cbc2ae700 1 --2- 172.21.15.139:0/3577538840 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f3c94039be0 0x7f3c9403c0a0 crc :-1 s=READY pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:41.708 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.705+0000 7f3cbc2ae700 1 -- 172.21.15.139:0/3577538840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cb4135250 msgr2=0x7f3cb412b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:41.708 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.705+0000 7f3cbc2ae700 1 --2- 172.21.15.139:0/3577538840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cb4135250 0x7f3cb412b6b0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f3cac0032b0 tx=0x7f3cac010ca0).stop 2020-02-12T14:12:41.709 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.705+0000 7f3cbc2ae700 1 -- 172.21.15.139:0/3577538840 shutdown_connections 2020-02-12T14:12:41.709 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.705+0000 7f3cbc2ae700 1 --2- 172.21.15.139:0/3577538840 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f3c94039be0 0x7f3c9403c0a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:41.709 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.705+0000 7f3cbc2ae700 1 --2- 172.21.15.139:0/3577538840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cb4135250 0x7f3cb412b6b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:41.709 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.705+0000 7f3cbc2ae700 1 --2- 172.21.15.139:0/3577538840 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3cb40a3f40 0x7f3cb4130970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:41.709 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.705+0000 7f3cbc2ae700 1 -- 172.21.15.139:0/3577538840 >> 172.21.15.139:0/3577538840 conn(0x7f3cb4060950 msgr2=0x7f3cb405e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:41.709 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.705+0000 7f3cbc2ae700 1 -- 172.21.15.139:0/3577538840 shutdown_connections 2020-02-12T14:12:41.709 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.705+0000 7f3cbc2ae700 1 -- 172.21.15.139:0/3577538840 wait complete. 2020-02-12T14:12:41.718 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-02-12T14:12:41.719 INFO:tasks.ceph.mds.b:Restarting daemon 2020-02-12T14:12:41.719 INFO:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-02-12T14:12:41.721 INFO:tasks.ceph.mds.b:Started 2020-02-12T14:12:41.721 INFO:tasks.ceph.mds.a:Restarting daemon 2020-02-12T14:12:41.722 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-02-12T14:12:41.724 INFO:tasks.ceph.mds.a:Started 2020-02-12T14:12:41.724 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-12T14:12:41.724 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-02-12T14:12:41.797 INFO:tasks.ceph.mds.a.smithi139.stdout:starting mds.a at 2020-02-12T14:12:41.805 INFO:tasks.ceph.mds.b.smithi072.stdout:starting mds.b at 2020-02-12T14:12:41.833 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.830+0000 7f98d0f97700 1 Processor -- start 2020-02-12T14:12:41.833 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.831+0000 7f98d0f97700 1 -- start start 2020-02-12T14:12:41.835 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.831+0000 7f98d0f97700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98cc069ad0 0x7f98cc0a2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:41.836 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.831+0000 7f98d0f97700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f98cc0670d0 0x7f98cc0a7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:41.836 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.831+0000 7f98d0f97700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98cc066540 con 0x7f98cc0a7b60 2020-02-12T14:12:41.836 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.831+0000 7f98d0f97700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98cc09b4c0 con 0x7f98cc069ad0 2020-02-12T14:12:41.836 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.831+0000 7f98d0f97700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98cc0a5c30 con 0x7f98cc0670d0 2020-02-12T14:12:41.836 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.831+0000 7f98c9d9b700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f98cc0670d0 0x7f98cc0a7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:41.836 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.832+0000 7f98c9d9b700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f98cc0670d0 0x7f98cc0a7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46662/0 (socket says 172.21.15.139:46662) 2020-02-12T14:12:41.836 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.832+0000 7f98c9d9b700 1 -- 172.21.15.139:0/3663838438 learned_addr learned my addr 172.21.15.139:0/3663838438 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:41.837 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.832+0000 7f98ca59c700 1 --2- 172.21.15.139:0/3663838438 >> v2:172.21.15.72:3300/0 conn(0x7f98cc069ad0 0x7f98cc0a2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:41.837 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.832+0000 7f98c9d9b700 1 -- 172.21.15.139:0/3663838438 >> v2:172.21.15.72:3300/0 conn(0x7f98cc069ad0 msgr2=0x7f98cc0a2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:41.837 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.832+0000 7f98c9d9b700 1 --2- 172.21.15.139:0/3663838438 >> v2:172.21.15.72:3300/0 conn(0x7f98cc069ad0 0x7f98cc0a2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:41.837 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.832+0000 7f98c9d9b700 1 -- 172.21.15.139:0/3663838438 >> v1:172.21.15.72:6789/0 conn(0x7f98cc0a7b60 legacy=0x7f98cc0a7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:41.837 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.832+0000 7f98c9d9b700 1 -- 172.21.15.139:0/3663838438 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc066990 con 0x7f98cc0670d0 2020-02-12T14:12:41.837 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.832+0000 7f98c9d9b700 1 --2- 172.21.15.139:0/3663838438 >> v2:172.21.15.139:3300/0 conn(0x7f98cc0670d0 0x7f98cc0a7700 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f98c0002f30 tx=0x7f98c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.837 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.832+0000 7f98c9d9b700 1 --2- 172.21.15.139:0/3663838438 >> v2:172.21.15.139:3300/0 conn(0x7f98cc0670d0 0x7f98cc0a7700 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f98c0002f30 tx=0x7f98c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.838 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.832+0000 7f98c9d9b700 1 --2- 172.21.15.139:0/3663838438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98cc0670d0 0x7f98cc0a7700 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7f98c0002f30 tx=0x7f98c0007a40).ready entity=mon.1 client_cookie=67b04b5f2f891910 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:41.838 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.832+0000 7f98c9d9b700 1 --2- 172.21.15.139:0/3663838438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98cc0670d0 0x7f98cc0a7700 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f98c0002f30 tx=0x7f98c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.838 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.832+0000 7f98c959a700 1 -- 172.21.15.139:0/3663838438 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98c0011720 con 0x7f98cc0670d0 2020-02-12T14:12:41.838 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.832+0000 7f98c9d9b700 1 --2- 172.21.15.139:0/3663838438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98cc0670d0 0x7f98cc0a7700 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f98c0002f30 tx=0x7f98c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.838 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.832+0000 7f98c959a700 1 -- 172.21.15.139:0/3663838438 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c0011880 con 0x7f98cc0670d0 2020-02-12T14:12:41.838 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.832+0000 7f98c9d9b700 1 --2- 172.21.15.139:0/3663838438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98cc0670d0 0x7f98cc0a7700 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f98c0002f30 tx=0x7f98c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.838 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.832+0000 7f98c959a700 1 -- 172.21.15.139:0/3663838438 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98c0011c60 con 0x7f98cc0670d0 2020-02-12T14:12:41.838 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.832+0000 7f98d0f97700 1 -- 172.21.15.139:0/3663838438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98cc0670d0 msgr2=0x7f98cc0a7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:41.839 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.832+0000 7f98d0f97700 1 --2- 172.21.15.139:0/3663838438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98cc0670d0 0x7f98cc0a7700 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7f98c0002f30 tx=0x7f98c0007a40).stop 2020-02-12T14:12:41.839 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.833+0000 7f98d0f97700 1 -- 172.21.15.139:0/3663838438 shutdown_connections 2020-02-12T14:12:41.839 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.833+0000 7f98d0f97700 1 --2- 172.21.15.139:0/3663838438 >> v2:172.21.15.72:3300/0 conn(0x7f98cc069ad0 0x7f98cc0a2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:41.839 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.833+0000 7f98d0f97700 1 --2- 172.21.15.139:0/3663838438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98cc0670d0 0x7f98cc0a7700 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:41.839 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.833+0000 7f98d0f97700 1 -- 172.21.15.139:0/3663838438 >> 172.21.15.139:0/3663838438 conn(0x7f98cc060df0 msgr2=0x7f98cc05a720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:41.839 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.833+0000 7f98d0f97700 1 -- 172.21.15.139:0/3663838438 shutdown_connections 2020-02-12T14:12:41.839 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.833+0000 7f98d0f97700 1 -- 172.21.15.139:0/3663838438 wait complete. 2020-02-12T14:12:41.839 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.833+0000 7f98d0f97700 1 Processor -- start 2020-02-12T14:12:41.840 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.833+0000 7f98d0f97700 1 -- start start 2020-02-12T14:12:41.843 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.834+0000 7f98d0f97700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98cc0670d0 0x7f98cc145a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:41.843 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.834+0000 7f98d0f97700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f98cc069ad0 0x7f98cc134e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:41.843 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.834+0000 7f98d0f97700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98cc1461a0 con 0x7f98cc0a7b60 2020-02-12T14:12:41.843 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.834+0000 7f98d0f97700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98cc1349c0 con 0x7f98cc0670d0 2020-02-12T14:12:41.843 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.834+0000 7f98d0f97700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98cc145e80 con 0x7f98cc069ad0 2020-02-12T14:12:41.843 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.834+0000 7f98c9d9b700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f98cc069ad0 0x7f98cc134e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:41.843 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.834+0000 7f98ca59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98cc0670d0 0x7f98cc145a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:41.844 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.834+0000 7f98c9d9b700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f98cc069ad0 0x7f98cc134e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46666/0 (socket says 172.21.15.139:46666) 2020-02-12T14:12:41.844 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.834+0000 7f98c9d9b700 1 -- 172.21.15.139:0/2595033376 learned_addr learned my addr 172.21.15.139:0/2595033376 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:41.844 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.834+0000 7f98cad9d700 1 --1- 172.21.15.139:0/2595033376 >> v1:172.21.15.139:6789/0 conn(0x7f98cc0a7b60 0x7f98cc0a0410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35304/0 (socket says 172.21.15.139:35304) 2020-02-12T14:12:41.844 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.834+0000 7f98c9d9b700 1 -- 172.21.15.139:0/2595033376 >> v2:172.21.15.72:3300/0 conn(0x7f98cc0670d0 msgr2=0x7f98cc145a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:41.844 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.834+0000 7f98c9d9b700 1 --2- 172.21.15.139:0/2595033376 >> v2:172.21.15.72:3300/0 conn(0x7f98cc0670d0 0x7f98cc145a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:41.844 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.834+0000 7f98c9d9b700 1 -- 172.21.15.139:0/2595033376 >> v1:172.21.15.139:6789/0 conn(0x7f98cc0a7b60 legacy=0x7f98cc0a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:41.844 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.834+0000 7f98c9d9b700 1 -- 172.21.15.139:0/2595033376 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc1363b0 con 0x7f98cc069ad0 2020-02-12T14:12:41.844 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.834+0000 7f98bb7fe700 1 -- 172.21.15.139:0/2595033376 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110810318 0 0) 0x7f98cc1461a0 con 0x7f98cc0a7b60 2020-02-12T14:12:41.845 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.834+0000 7f98c9d9b700 1 --2- 172.21.15.139:0/2595033376 >> v2:172.21.15.139:3300/0 conn(0x7f98cc069ad0 0x7f98cc134e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f98c0002f30 tx=0x7f98c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.845 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.835+0000 7f98c9d9b700 1 --2- 172.21.15.139:0/2595033376 >> v2:172.21.15.139:3300/0 conn(0x7f98cc069ad0 0x7f98cc134e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f98c0002f30 tx=0x7f98c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.845 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.835+0000 7f98c9d9b700 1 --2- 172.21.15.139:0/2595033376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98cc069ad0 0x7f98cc134e60 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f98c0002f30 tx=0x7f98c0007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:41.845 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.835+0000 7f98c9d9b700 1 --2- 172.21.15.139:0/2595033376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98cc069ad0 0x7f98cc134e60 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f98c0002f30 tx=0x7f98c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.845 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.835+0000 7f98bb7fe700 1 -- 172.21.15.139:0/2595033376 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98c0007340 con 0x7f98cc069ad0 2020-02-12T14:12:41.845 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.835+0000 7f98c9d9b700 1 --2- 172.21.15.139:0/2595033376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98cc069ad0 0x7f98cc134e60 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f98c0002f30 tx=0x7f98c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.845 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.835+0000 7f98c9d9b700 1 --2- 172.21.15.139:0/2595033376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98cc069ad0 0x7f98cc134e60 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f98c0002f30 tx=0x7f98c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.846 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.835+0000 7f98bb7fe700 1 -- 172.21.15.139:0/2595033376 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c00074a0 con 0x7f98cc069ad0 2020-02-12T14:12:41.846 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.835+0000 7f98d0f97700 1 -- 172.21.15.139:0/2595033376 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98cc0a9410 con 0x7f98cc069ad0 2020-02-12T14:12:41.846 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.835+0000 7f98bb7fe700 1 -- 172.21.15.139:0/2595033376 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98c00058b0 con 0x7f98cc069ad0 2020-02-12T14:12:41.846 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.835+0000 7f98d0f97700 1 -- 172.21.15.139:0/2595033376 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98cc0a0ce0 con 0x7f98cc069ad0 2020-02-12T14:12:41.846 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.835+0000 7f98c9d9b700 1 --2- 172.21.15.139:0/2595033376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98cc069ad0 0x7f98cc134e60 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f98c0002f30 tx=0x7f98c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.846 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.835+0000 7f98bb7fe700 1 -- 172.21.15.139:0/2595033376 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f98c0005ae0 con 0x7f98cc069ad0 2020-02-12T14:12:41.846 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.835+0000 7f98c9d9b700 1 --2- 172.21.15.139:0/2595033376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98cc069ad0 0x7f98cc134e60 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f98c0002f30 tx=0x7f98c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.846 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.836+0000 7f98bb7fe700 1 --2- 172.21.15.139:0/2595033376 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f98a8039b00 0x7f98a803bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:41.847 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.836+0000 7f98bb7fe700 1 -- 172.21.15.139:0/2595033376 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f98c0049ea0 con 0x7f98cc069ad0 2020-02-12T14:12:41.847 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.836+0000 7f98ca59c700 1 --2- 172.21.15.139:0/2595033376 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f98a8039b00 0x7f98a803bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:41.847 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.836+0000 7f98d0f97700 1 -- 172.21.15.139:0/2595033376 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98cc145ff0 con 0x7f98cc069ad0 2020-02-12T14:12:41.847 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.836+0000 7f98ca59c700 1 --2- 172.21.15.139:0/2595033376 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f98a8039b00 0x7f98a803bfc0 crc :-1 s=READY pgs=49 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:41.847 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.839+0000 7f98c9d9b700 1 --2- 172.21.15.139:0/2595033376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98cc069ad0 0x7f98cc134e60 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f98c0002f30 tx=0x7f98c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.847 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.839+0000 7f98bb7fe700 1 -- 172.21.15.139:0/2595033376 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f98c00324e0 con 0x7f98cc069ad0 2020-02-12T14:12:41.976 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.974+0000 7f98d0f97700 1 -- 172.21.15.139:0/2595033376 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98cc067e20 con 0x7f98cc069ad0 2020-02-12T14:12:41.977 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.974+0000 7f98c9d9b700 1 --2- 172.21.15.139:0/2595033376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98cc069ad0 0x7f98cc134e60 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f98c0002f30 tx=0x7f98c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:41.977 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.974+0000 7f98bb7fe700 1 -- 172.21.15.139:0/2595033376 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14933 (secure 0 0 0) 0x7f98c00320a0 con 0x7f98cc069ad0 2020-02-12T14:12:41.977 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:12:41.977 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":23,"fsid":"dacc9a6c-9e88-46ac-940b-c4a329dbffec","created":"2020-02-12T14:12:18.258232+0000","modified":"2020-02-12T14:12:39.447885+0000","last_up_change":"2020-02-12T14:12:27.050924+0000","last_in_change":"2020-02-12T14:12:27.050924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-12T14:12:31.091380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-02-12T14:12:34.160095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-02-12T14:12:37.119732+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffc0664d-9b93-45a4-a454-7655ee26d582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":22147},{"type":"v1","addr":"172.21.15.139:6803","nonce":22147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":22147},{"type":"v1","addr":"172.21.15.139:6805","nonce":22147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":22147},{"type":"v1","addr":"172.21.15.139:6809","nonce":22147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":22147},{"type":"v1","addr":"172.21.15.139:6807","nonce":22147}]},"public_addr":"172.21.15.139:6803/22147","cluster_addr":"172.21.15.139:6805/22147","heartbeat_back_addr":"172.21.15.139:6809/22147","heartbeat_front_addr":"172.21.15.139:6807/22147","state":["exists","up"]},{"osd":1,"uuid":"f66da6bc-43b3-4846-85f9-a25e3fe95216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":22148},{"type":"v1","addr":"172.21.15.139:6811","nonce":22148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":22148},{"type":"v1","addr":"172.21.15.139:6813","nonce":22148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6819","nonce":22148},{"type":"v1","addr":"172.21.15.139:6821","nonce":22148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6815","nonce":22148},{"type":"v1","addr":"172.21.15.139:6817","nonce":22148}]},"public_addr":"172.21.15.139:6811/22148","cluster_addr":"172.21.15.139:6813/22148","heartbeat_back_addr":"172.21.15.139:6821/22148","heartbeat_front_addr":"172.21.15.139:6817/22148","state":["exists","up"]},{"osd":2,"uuid":"c35fb293-3e16-41e8-85f3-768e11e55b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":22149},{"type":"v1","addr":"172.21.15.139:6827","nonce":22149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":22149},{"type":"v1","addr":"172.21.15.139:6829","nonce":22149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":22149},{"type":"v1","addr":"172.21.15.139:6833","nonce":22149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":22149},{"type":"v1","addr":"172.21.15.139:6831","nonce":22149}]},"public_addr":"172.21.15.139:6827/22149","cluster_addr":"172.21.15.139:6829/22149","heartbeat_back_addr":"172.21.15.139:6833/22149","heartbeat_front_addr":"172.21.15.139:6831/22149","state":["exists","up"]},{"osd":3,"uuid":"bc8b2c0d-e3dd-48cb-883e-6ea965aee923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":22150},{"type":"v1","addr":"172.21.15.139:6816","nonce":22150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":22150},{"type":"v1","addr":"172.21.15.139:6820","nonce":22150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":22150},{"type":"v1","addr":"172.21.15.139:6825","nonce":22150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":22150},{"type":"v1","addr":"172.21.15.139:6823","nonce":22150}]},"public_addr":"172.21.15.139:6816/22150","cluster_addr":"172.21.15.139:6820/22150","heartbeat_back_addr":"172.21.15.139:6825/22150","heartbeat_front_addr":"172.21.15.139:6823/22150","state":["exists","up"]},{"osd":4,"uuid":"aadfc406-0c40-4b6b-9e19-c92b2f40264a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":21598},{"type":"v1","addr":"172.21.15.72:6801","nonce":21598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":21598},{"type":"v1","addr":"172.21.15.72:6803","nonce":21598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":21598},{"type":"v1","addr":"172.21.15.72:6807","nonce":21598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":21598},{"type":"v1","addr":"172.21.15.72:6805","nonce":21598}]},"public_addr":"172.21.15.72:6801/21598","cluster_addr":"172.21.15.72:6803/21598","heartbeat_back_addr":"172.21.15.72:6807/21598","heartbeat_front_addr":"172.21.15.72:6805/21598","state":["exists","up"]},{"osd":5,"uuid":"3296dc8e-9322-4430-abd2-7672da5b7acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":21599},{"type":"v1","addr":"172.21.15.72:6810","nonce":21599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":21599},{"type":"v1","addr":"172.21.15.72:6815","nonce":21599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":21599},{"type":"v1","addr":"172.21.15.72:6823","nonce":21599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":21599},{"type":"v1","addr":"172.21.15.72:6820","nonce":21599}]},"public_addr":"172.21.15.72:6810/21599","cluster_addr":"172.21.15.72:6815/21599","heartbeat_back_addr":"172.21.15.72:6823/21599","heartbeat_front_addr":"172.21.15.72:6820/21599","state":["exists","up"]},{"osd":6,"uuid":"7c39cf20-a3a8-4d56-8577-f4102b302a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":21601},{"type":"v1","addr":"172.21.15.72:6811","nonce":21601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":21601},{"type":"v1","addr":"172.21.15.72:6814","nonce":21601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":21601},{"type":"v1","addr":"172.21.15.72:6821","nonce":21601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":21601},{"type":"v1","addr":"172.21.15.72:6818","nonce":21601}]},"public_addr":"172.21.15.72:6811/21601","cluster_addr":"172.21.15.72:6814/21601","heartbeat_back_addr":"172.21.15.72:6821/21601","heartbeat_front_addr":"172.21.15.72:6818/21601","state":["exists","up"]},{"osd":7,"uuid":"f452adff-8432-47e9-a5f1-9fd7e2a04a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":21600},{"type":"v1","addr":"172.21.15.72:6825","nonce":21600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":21600},{"type":"v1","addr":"172.21.15.72:6827","nonce":21600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":21600},{"type":"v1","addr":"172.21.15.72:6831","nonce":21600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":21600},{"type":"v1","addr":"172.21.15.72:6829","nonce":21600}]},"public_addr":"172.21.15.72:6825/21600","cluster_addr":"172.21.15.72:6827/21600","heartbeat_back_addr":"172.21.15.72:6831/21600","heartbeat_front_addr":"172.21.15.72:6829/21600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.259782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.267019+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.315501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.326256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.335328+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.284130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.083179+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.351445+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-12T14:12:41.978 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.976+0000 7f98d0f97700 1 -- 172.21.15.139:0/2595033376 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f98a8039b00 msgr2=0x7f98a803bfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:41.978 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.976+0000 7f98d0f97700 1 --2- 172.21.15.139:0/2595033376 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f98a8039b00 0x7f98a803bfc0 crc :-1 s=READY pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:41.978 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.976+0000 7f98d0f97700 1 -- 172.21.15.139:0/2595033376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98cc069ad0 msgr2=0x7f98cc134e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.976+0000 7f98d0f97700 1 --2- 172.21.15.139:0/2595033376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98cc069ad0 0x7f98cc134e60 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f98c0002f30 tx=0x7f98c0007a40).stop 2020-02-12T14:12:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.976+0000 7f98d0f97700 1 -- 172.21.15.139:0/2595033376 shutdown_connections 2020-02-12T14:12:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.976+0000 7f98d0f97700 1 --2- 172.21.15.139:0/2595033376 >> v2:172.21.15.72:3300/0 conn(0x7f98cc0670d0 0x7f98cc145a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.976+0000 7f98d0f97700 1 --2- 172.21.15.139:0/2595033376 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f98a8039b00 0x7f98a803bfc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.976+0000 7f98d0f97700 1 --2- 172.21.15.139:0/2595033376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98cc069ad0 0x7f98cc134e60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.976+0000 7f98d0f97700 1 -- 172.21.15.139:0/2595033376 >> 172.21.15.139:0/2595033376 conn(0x7f98cc060df0 msgr2=0x7f98cc05e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.976+0000 7f98d0f97700 1 -- 172.21.15.139:0/2595033376 shutdown_connections 2020-02-12T14:12:41.980 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:41.976+0000 7f98d0f97700 1 -- 172.21.15.139:0/2595033376 wait complete. 2020-02-12T14:12:41.989 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-12T14:12:31.091380+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-12T14:12:34.160095+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-12T14:12:37.119732+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-02-12T14:12:41.989 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-02-12T14:12:42.097 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.095+0000 7f75ed6f5700 1 Processor -- start 2020-02-12T14:12:42.097 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.095+0000 7f75ed6f5700 1 -- start start 2020-02-12T14:12:42.100 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.096+0000 7f75ed6f5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f75e80a3f40 0x7f75e8134df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:42.100 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.096+0000 7f75ed6f5700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f75e80a24a0 0x7f75e812e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:42.100 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.096+0000 7f75ed6f5700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e81359e0 con 0x7f75e8135250 2020-02-12T14:12:42.100 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.096+0000 7f75ed6f5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e8135c80 con 0x7f75e80a3f40 2020-02-12T14:12:42.100 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.096+0000 7f75ed6f5700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e80a18f0 con 0x7f75e80a24a0 2020-02-12T14:12:42.101 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.096+0000 7f75e77fe700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f75e80a24a0 0x7f75e812e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:42.101 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.096+0000 7f75dffff700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f75e8135250 0x7f75e80a1d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35312/0 (socket says 172.21.15.139:35312) 2020-02-12T14:12:42.101 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.096+0000 7f75dffff700 1 -- 172.21.15.139:0/978294295 learned_addr learned my addr 172.21.15.139:0/978294295 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:42.101 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.096+0000 7f75e6ffd700 1 --2- 172.21.15.139:0/978294295 >> v2:172.21.15.72:3300/0 conn(0x7f75e80a3f40 0x7f75e8134df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:42.101 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.096+0000 7f75e77fe700 1 -- 172.21.15.139:0/978294295 >> v2:172.21.15.72:3300/0 conn(0x7f75e80a3f40 msgr2=0x7f75e8134df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:42.101 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.096+0000 7f75e77fe700 1 --2- 172.21.15.139:0/978294295 >> v2:172.21.15.72:3300/0 conn(0x7f75e80a3f40 0x7f75e8134df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:42.102 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.096+0000 7f75e77fe700 1 -- 172.21.15.139:0/978294295 >> v1:172.21.15.139:6789/0 conn(0x7f75e8135250 legacy=0x7f75e80a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:42.102 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.096+0000 7f75e67fc700 1 -- 172.21.15.139:0/978294295 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 311859174 0 0) 0x7f75e81359e0 con 0x7f75e8135250 2020-02-12T14:12:42.102 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.096+0000 7f75e77fe700 1 -- 172.21.15.139:0/978294295 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e81356e0 con 0x7f75e80a24a0 2020-02-12T14:12:42.102 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.096+0000 7f75e77fe700 1 --2- 172.21.15.139:0/978294295 >> v2:172.21.15.139:3300/0 conn(0x7f75e80a24a0 0x7f75e812e6b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f75e00032b0 tx=0x7f75e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.103 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.096+0000 7f75e77fe700 1 --2- 172.21.15.139:0/978294295 >> v2:172.21.15.139:3300/0 conn(0x7f75e80a24a0 0x7f75e812e6b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f75e00032b0 tx=0x7f75e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.103 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.096+0000 7f75e77fe700 1 --2- 172.21.15.139:0/978294295 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75e80a24a0 0x7f75e812e6b0 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f75e00032b0 tx=0x7f75e0007dc0).ready entity=mon.1 client_cookie=9e5b0068578605af server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:42.103 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.096+0000 7f75e77fe700 1 --2- 172.21.15.139:0/978294295 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75e80a24a0 0x7f75e812e6b0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f75e00032b0 tx=0x7f75e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.103 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.096+0000 7f75e67fc700 1 -- 172.21.15.139:0/978294295 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75e0011e20 con 0x7f75e80a24a0 2020-02-12T14:12:42.103 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.096+0000 7f75e77fe700 1 --2- 172.21.15.139:0/978294295 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75e80a24a0 0x7f75e812e6b0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f75e00032b0 tx=0x7f75e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.103 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.096+0000 7f75e77fe700 1 --2- 172.21.15.139:0/978294295 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75e80a24a0 0x7f75e812e6b0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f75e00032b0 tx=0x7f75e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.103 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.096+0000 7f75e67fc700 1 -- 172.21.15.139:0/978294295 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e000a160 con 0x7f75e80a24a0 2020-02-12T14:12:42.104 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.096+0000 7f75e67fc700 1 -- 172.21.15.139:0/978294295 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75e000a500 con 0x7f75e80a24a0 2020-02-12T14:12:42.104 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.096+0000 7f75ed6f5700 1 -- 172.21.15.139:0/978294295 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75e80a24a0 msgr2=0x7f75e812e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:42.104 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.096+0000 7f75ed6f5700 1 --2- 172.21.15.139:0/978294295 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75e80a24a0 0x7f75e812e6b0 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f75e00032b0 tx=0x7f75e0007dc0).stop 2020-02-12T14:12:42.104 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.097+0000 7f75ed6f5700 1 -- 172.21.15.139:0/978294295 shutdown_connections 2020-02-12T14:12:42.104 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.097+0000 7f75ed6f5700 1 --2- 172.21.15.139:0/978294295 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75e80a24a0 0x7f75e812e6b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:42.104 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.097+0000 7f75ed6f5700 1 --2- 172.21.15.139:0/978294295 >> v2:172.21.15.72:3300/0 conn(0x7f75e80a3f40 0x7f75e8134df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:42.104 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.097+0000 7f75ed6f5700 1 -- 172.21.15.139:0/978294295 >> 172.21.15.139:0/978294295 conn(0x7f75e8060950 msgr2=0x7f75e809d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:42.105 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.097+0000 7f75ed6f5700 1 -- 172.21.15.139:0/978294295 shutdown_connections 2020-02-12T14:12:42.105 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.097+0000 7f75ed6f5700 1 -- 172.21.15.139:0/978294295 wait complete. 2020-02-12T14:12:42.105 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.098+0000 7f75ed6f5700 1 Processor -- start 2020-02-12T14:12:42.105 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.098+0000 7f75ed6f5700 1 -- start start 2020-02-12T14:12:42.108 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.098+0000 7f75ed6f5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f75e80a24a0 0x7f75e8065370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:42.108 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.098+0000 7f75ed6f5700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f75e8135250 0x7f75e81265e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:42.108 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.098+0000 7f75ed6f5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e8066120 con 0x7f75e80a3f40 2020-02-12T14:12:42.108 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.098+0000 7f75ed6f5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e80663c0 con 0x7f75e80a24a0 2020-02-12T14:12:42.108 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.098+0000 7f75ed6f5700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e80a4a50 con 0x7f75e8135250 2020-02-12T14:12:42.108 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.098+0000 7f75e77fe700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f75e8135250 0x7f75e81265e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:42.108 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.098+0000 7f75e77fe700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f75e8135250 0x7f75e81265e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46682/0 (socket says 172.21.15.139:46682) 2020-02-12T14:12:42.109 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.098+0000 7f75e77fe700 1 -- 172.21.15.139:0/796348313 learned_addr learned my addr 172.21.15.139:0/796348313 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:42.109 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.099+0000 7f75e6ffd700 1 --2- 172.21.15.139:0/796348313 >> v2:172.21.15.72:3300/0 conn(0x7f75e80a24a0 0x7f75e8065370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:42.109 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.099+0000 7f75e77fe700 1 -- 172.21.15.139:0/796348313 >> v2:172.21.15.72:3300/0 conn(0x7f75e80a24a0 msgr2=0x7f75e8065370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:42.109 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.099+0000 7f75e77fe700 1 --2- 172.21.15.139:0/796348313 >> v2:172.21.15.72:3300/0 conn(0x7f75e80a24a0 0x7f75e8065370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:42.109 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.099+0000 7f75e77fe700 1 -- 172.21.15.139:0/796348313 >> v1:172.21.15.72:6789/0 conn(0x7f75e80a3f40 legacy=0x7f75e805aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:42.109 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.099+0000 7f75e77fe700 1 -- 172.21.15.139:0/796348313 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e8065d60 con 0x7f75e8135250 2020-02-12T14:12:42.109 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.099+0000 7f75e77fe700 1 --2- 172.21.15.139:0/796348313 >> v2:172.21.15.139:3300/0 conn(0x7f75e8135250 0x7f75e81265e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f75e8127730 tx=0x7f75e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.109 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.099+0000 7f75e77fe700 1 --2- 172.21.15.139:0/796348313 >> v2:172.21.15.139:3300/0 conn(0x7f75e8135250 0x7f75e81265e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f75e8127730 tx=0x7f75e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.099+0000 7f75e77fe700 1 --2- 172.21.15.139:0/796348313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75e8135250 0x7f75e81265e0 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f75e8127730 tx=0x7f75e0007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:42.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.099+0000 7f75e77fe700 1 --2- 172.21.15.139:0/796348313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75e8135250 0x7f75e81265e0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f75e8127730 tx=0x7f75e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.099+0000 7f75e77fe700 1 --2- 172.21.15.139:0/796348313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75e8135250 0x7f75e81265e0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f75e8127730 tx=0x7f75e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.099+0000 7f75e77fe700 1 --2- 172.21.15.139:0/796348313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75e8135250 0x7f75e81265e0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f75e8127730 tx=0x7f75e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.099+0000 7f75e4ff9700 1 -- 172.21.15.139:0/796348313 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75e0005a40 con 0x7f75e8135250 2020-02-12T14:12:42.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.099+0000 7f75e4ff9700 1 -- 172.21.15.139:0/796348313 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e0005ba0 con 0x7f75e8135250 2020-02-12T14:12:42.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.099+0000 7f75ed6f5700 1 -- 172.21.15.139:0/796348313 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e8127c10 con 0x7f75e8135250 2020-02-12T14:12:42.111 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.099+0000 7f75e4ff9700 1 -- 172.21.15.139:0/796348313 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75e000f570 con 0x7f75e8135250 2020-02-12T14:12:42.111 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.099+0000 7f75ed6f5700 1 -- 172.21.15.139:0/796348313 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e805b3f0 con 0x7f75e8135250 2020-02-12T14:12:42.111 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.100+0000 7f75e77fe700 1 --2- 172.21.15.139:0/796348313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75e8135250 0x7f75e81265e0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f75e8127730 tx=0x7f75e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.111 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.100+0000 7f75e4ff9700 1 -- 172.21.15.139:0/796348313 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f75e000f7e0 con 0x7f75e8135250 2020-02-12T14:12:42.111 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.100+0000 7f75e77fe700 1 --2- 172.21.15.139:0/796348313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75e8135250 0x7f75e81265e0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f75e8127730 tx=0x7f75e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.111 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.100+0000 7f75ed6f5700 1 -- 172.21.15.139:0/796348313 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e8066590 con 0x7f75e8135250 2020-02-12T14:12:42.111 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.100+0000 7f75e4ff9700 1 --2- 172.21.15.139:0/796348313 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f75cc039cf0 0x7f75cc03c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:42.111 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.100+0000 7f75e4ff9700 1 -- 172.21.15.139:0/796348313 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f75e004a840 con 0x7f75e8135250 2020-02-12T14:12:42.112 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.100+0000 7f75e6ffd700 1 --2- 172.21.15.139:0/796348313 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f75cc039cf0 0x7f75cc03c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:42.112 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.100+0000 7f75e6ffd700 1 --2- 172.21.15.139:0/796348313 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f75cc039cf0 0x7f75cc03c1b0 crc :-1 s=READY pgs=50 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:42.112 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.103+0000 7f75e77fe700 1 --2- 172.21.15.139:0/796348313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75e8135250 0x7f75e81265e0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f75e8127730 tx=0x7f75e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.112 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.103+0000 7f75e4ff9700 1 -- 172.21.15.139:0/796348313 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f75e002ff70 con 0x7f75e8135250 2020-02-12T14:12:42.249 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.246+0000 7f75ed6f5700 1 -- 172.21.15.139:0/796348313 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f75e805a7b0 con 0x7f75e8135250 2020-02-12T14:12:42.249 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.247+0000 7f75e77fe700 1 --2- 172.21.15.139:0/796348313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75e8135250 0x7f75e81265e0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f75e8127730 tx=0x7f75e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.249 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.247+0000 7f75e4ff9700 1 -- 172.21.15.139:0/796348313 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f75e0032a40 con 0x7f75e8135250 2020-02-12T14:12:42.249 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 8 2020-02-12T14:12:42.251 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.248+0000 7f75ed6f5700 1 -- 172.21.15.139:0/796348313 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f75cc039cf0 msgr2=0x7f75cc03c1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:42.251 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.248+0000 7f75ed6f5700 1 --2- 172.21.15.139:0/796348313 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f75cc039cf0 0x7f75cc03c1b0 crc :-1 s=READY pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:42.251 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.248+0000 7f75ed6f5700 1 -- 172.21.15.139:0/796348313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75e8135250 msgr2=0x7f75e81265e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:42.251 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.248+0000 7f75ed6f5700 1 --2- 172.21.15.139:0/796348313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75e8135250 0x7f75e81265e0 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f75e8127730 tx=0x7f75e0007dc0).stop 2020-02-12T14:12:42.251 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.248+0000 7f75ed6f5700 1 -- 172.21.15.139:0/796348313 shutdown_connections 2020-02-12T14:12:42.252 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.248+0000 7f75ed6f5700 1 --2- 172.21.15.139:0/796348313 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f75cc039cf0 0x7f75cc03c1b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:42.252 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.248+0000 7f75ed6f5700 1 --2- 172.21.15.139:0/796348313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75e8135250 0x7f75e81265e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:42.252 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.248+0000 7f75ed6f5700 1 --2- 172.21.15.139:0/796348313 >> v2:172.21.15.72:3300/0 conn(0x7f75e80a24a0 0x7f75e8065370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:42.252 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.248+0000 7f75ed6f5700 1 -- 172.21.15.139:0/796348313 >> 172.21.15.139:0/796348313 conn(0x7f75e8060950 msgr2=0x7f75e805e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:42.252 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.248+0000 7f75ed6f5700 1 -- 172.21.15.139:0/796348313 shutdown_connections 2020-02-12T14:12:42.252 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.248+0000 7f75ed6f5700 1 -- 172.21.15.139:0/796348313 wait complete. 2020-02-12T14:12:42.260 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-02-12T14:12:42.367 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.365+0000 7f7c70599700 1 Processor -- start 2020-02-12T14:12:42.368 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.365+0000 7f7c70599700 1 -- start start 2020-02-12T14:12:42.370 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.366+0000 7f7c70599700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7c680a3f40 0x7f7c68134df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:42.370 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.366+0000 7f7c70599700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7c68135250 0x7f7c680a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:42.371 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.366+0000 7f7c70599700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c680a21f0 0x7f7c68138340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:42.371 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.366+0000 7f7c70599700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c681359e0 con 0x7f7c680a3f40 2020-02-12T14:12:42.371 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.366+0000 7f7c70599700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c68135c80 con 0x7f7c68135250 2020-02-12T14:12:42.371 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.366+0000 7f7c70599700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c680a18f0 con 0x7f7c680a21f0 2020-02-12T14:12:42.371 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.366+0000 7f7c6db34700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7c68135250 0x7f7c680a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:42.371 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.366+0000 7f7c6db34700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7c68135250 0x7f7c680a1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46694/0 (socket says 172.21.15.139:46694) 2020-02-12T14:12:42.371 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.366+0000 7f7c6db34700 1 -- 172.21.15.139:0/2301394375 learned_addr learned my addr 172.21.15.139:0/2301394375 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:42.372 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.366+0000 7f7c6eb36700 1 --2- 172.21.15.139:0/2301394375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c680a21f0 0x7f7c68138340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:42.372 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.366+0000 7f7c6e335700 1 --2- 172.21.15.139:0/2301394375 >> v2:172.21.15.72:3300/0 conn(0x7f7c680a3f40 0x7f7c68134df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:42.372 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.367+0000 7f7c6db34700 1 -- 172.21.15.139:0/2301394375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c680a21f0 msgr2=0x7f7c68138340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:42.372 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.367+0000 7f7c6db34700 1 --2- 172.21.15.139:0/2301394375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c680a21f0 0x7f7c68138340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:42.372 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.367+0000 7f7c6db34700 1 -- 172.21.15.139:0/2301394375 >> v2:172.21.15.72:3300/0 conn(0x7f7c680a3f40 msgr2=0x7f7c68134df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:42.372 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.367+0000 7f7c6db34700 1 --2- 172.21.15.139:0/2301394375 >> v2:172.21.15.72:3300/0 conn(0x7f7c680a3f40 0x7f7c68134df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:42.372 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.367+0000 7f7c6db34700 1 -- 172.21.15.139:0/2301394375 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c681356e0 con 0x7f7c68135250 2020-02-12T14:12:42.373 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.367+0000 7f7c6e335700 1 --2- 172.21.15.139:0/2301394375 >> v2:172.21.15.72:3300/0 conn(0x7f7c680a3f40 0x7f7c68134df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-12T14:12:42.373 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.367+0000 7f7c6db34700 1 --2- 172.21.15.139:0/2301394375 >> v2:172.21.15.139:3300/0 conn(0x7f7c68135250 0x7f7c680a1d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7c64002f30 tx=0x7f7c64007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.373 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.367+0000 7f7c6db34700 1 --2- 172.21.15.139:0/2301394375 >> v2:172.21.15.139:3300/0 conn(0x7f7c68135250 0x7f7c680a1d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7c64002f30 tx=0x7f7c64007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.373 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.367+0000 7f7c6db34700 1 --2- 172.21.15.139:0/2301394375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c68135250 0x7f7c680a1d90 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f7c64002f30 tx=0x7f7c64007a40).ready entity=mon.1 client_cookie=b110dc19cf83b055 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:42.373 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.367+0000 7f7c6db34700 1 --2- 172.21.15.139:0/2301394375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c68135250 0x7f7c680a1d90 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f7c64002f30 tx=0x7f7c64007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.373 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.367+0000 7f7c6d333700 1 -- 172.21.15.139:0/2301394375 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c64011720 con 0x7f7c68135250 2020-02-12T14:12:42.373 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.367+0000 7f7c6db34700 1 --2- 172.21.15.139:0/2301394375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c68135250 0x7f7c680a1d90 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f7c64002f30 tx=0x7f7c64007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.374 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.367+0000 7f7c6d333700 1 -- 172.21.15.139:0/2301394375 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c64011880 con 0x7f7c68135250 2020-02-12T14:12:42.374 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.367+0000 7f7c6db34700 1 --2- 172.21.15.139:0/2301394375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c68135250 0x7f7c680a1d90 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f7c64002f30 tx=0x7f7c64007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.374 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.367+0000 7f7c6d333700 1 -- 172.21.15.139:0/2301394375 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c64011c20 con 0x7f7c68135250 2020-02-12T14:12:42.374 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.367+0000 7f7c70599700 1 -- 172.21.15.139:0/2301394375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c68135250 msgr2=0x7f7c680a1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:42.374 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.367+0000 7f7c70599700 1 --2- 172.21.15.139:0/2301394375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c68135250 0x7f7c680a1d90 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f7c64002f30 tx=0x7f7c64007a40).stop 2020-02-12T14:12:42.374 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.367+0000 7f7c70599700 1 -- 172.21.15.139:0/2301394375 shutdown_connections 2020-02-12T14:12:42.375 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.367+0000 7f7c70599700 1 --2- 172.21.15.139:0/2301394375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c680a21f0 0x7f7c68138340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:42.375 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.367+0000 7f7c70599700 1 --2- 172.21.15.139:0/2301394375 >> v2:172.21.15.72:3300/0 conn(0x7f7c680a3f40 0x7f7c68134df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:42.375 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.367+0000 7f7c70599700 1 --2- 172.21.15.139:0/2301394375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c68135250 0x7f7c680a1d90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:42.375 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.367+0000 7f7c70599700 1 -- 172.21.15.139:0/2301394375 >> 172.21.15.139:0/2301394375 conn(0x7f7c68060950 msgr2=0x7f7c6809d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:42.375 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.367+0000 7f7c70599700 1 -- 172.21.15.139:0/2301394375 shutdown_connections 2020-02-12T14:12:42.375 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.367+0000 7f7c70599700 1 -- 172.21.15.139:0/2301394375 wait complete. 2020-02-12T14:12:42.375 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.368+0000 7f7c70599700 1 Processor -- start 2020-02-12T14:12:42.375 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.368+0000 7f7c70599700 1 -- start start 2020-02-12T14:12:42.378 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.369+0000 7f7c70599700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c680a21f0 0x7f7c68066b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:42.379 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.369+0000 7f7c70599700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c680a6110 con 0x7f7c680a3f40 2020-02-12T14:12:42.379 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.369+0000 7f7c70599700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c68065a10 con 0x7f7c68135250 2020-02-12T14:12:42.379 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.369+0000 7f7c70599700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c68065cb0 con 0x7f7c680a21f0 2020-02-12T14:12:42.379 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.369+0000 7f7c6eb36700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f7c68135250 0x7f7c68138780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35340/0 (socket says 172.21.15.139:35340) 2020-02-12T14:12:42.379 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.369+0000 7f7c6eb36700 1 -- 172.21.15.139:0/642358167 learned_addr learned my addr 172.21.15.139:0/642358167 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:42.379 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.369+0000 7f7c6e335700 1 --2- 172.21.15.139:0/642358167 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c680a21f0 0x7f7c68066b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:42.379 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.369+0000 7f7c577fe700 1 -- 172.21.15.139:0/642358167 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 605182497 0 0) 0x7f7c68065a10 con 0x7f7c68135250 2020-02-12T14:12:42.379 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.369+0000 7f7c577fe700 1 -- 172.21.15.139:0/642358167 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c48002fe0 con 0x7f7c68135250 2020-02-12T14:12:42.380 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.369+0000 7f7c577fe700 1 -- 172.21.15.139:0/642358167 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163423305 0 0) 0x7f7c680a6110 con 0x7f7c680a3f40 2020-02-12T14:12:42.380 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.369+0000 7f7c577fe700 1 -- 172.21.15.139:0/642358167 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c68065a10 con 0x7f7c680a3f40 2020-02-12T14:12:42.380 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.369+0000 7f7c577fe700 1 -- 172.21.15.139:0/642358167 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3922327599 0 0) 0x7f7c48002fe0 con 0x7f7c68135250 2020-02-12T14:12:42.380 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.369+0000 7f7c577fe700 1 -- 172.21.15.139:0/642358167 --> v1:172.21.15.139:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7c680a6110 con 0x7f7c68135250 2020-02-12T14:12:42.380 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.369+0000 7f7c577fe700 1 -- 172.21.15.139:0/642358167 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7f7c600018e0 con 0x7f7c68135250 2020-02-12T14:12:42.380 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.369+0000 7f7c6e335700 1 -- 172.21.15.139:0/642358167 >> v1:172.21.15.139:6789/0 conn(0x7f7c68135250 legacy=0x7f7c68138780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:42.380 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.369+0000 7f7c6e335700 1 -- 172.21.15.139:0/642358167 >> v1:172.21.15.72:6789/0 conn(0x7f7c680a3f40 legacy=0x7f7c680a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:42.380 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.369+0000 7f7c6e335700 1 -- 172.21.15.139:0/642358167 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c68066f60 con 0x7f7c680a21f0 2020-02-12T14:12:42.381 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.369+0000 7f7c6e335700 1 --2- 172.21.15.139:0/642358167 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c680a21f0 0x7f7c68066b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7c58002f30 tx=0x7f7c58010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.381 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.370+0000 7f7c6e335700 1 --2- 172.21.15.139:0/642358167 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c680a21f0 0x7f7c68066b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7c58002f30 tx=0x7f7c58010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.381 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.370+0000 7f7c6e335700 1 --2- 172.21.15.139:0/642358167 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c680a21f0 0x7f7c68066b00 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f7c58002f30 tx=0x7f7c58010960).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:42.381 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.370+0000 7f7c6e335700 1 --2- 172.21.15.139:0/642358167 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c680a21f0 0x7f7c68066b00 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f7c58002f30 tx=0x7f7c58010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.381 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.370+0000 7f7c577fe700 1 -- 172.21.15.139:0/642358167 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c58007540 con 0x7f7c680a21f0 2020-02-12T14:12:42.381 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.370+0000 7f7c6e335700 1 --2- 172.21.15.139:0/642358167 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c680a21f0 0x7f7c68066b00 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f7c58002f30 tx=0x7f7c58010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.381 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.370+0000 7f7c70599700 1 -- 172.21.15.139:0/642358167 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c68135f60 con 0x7f7c680a21f0 2020-02-12T14:12:42.382 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.370+0000 7f7c577fe700 1 -- 172.21.15.139:0/642358167 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c580058a0 con 0x7f7c680a21f0 2020-02-12T14:12:42.382 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.370+0000 7f7c6e335700 1 --2- 172.21.15.139:0/642358167 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c680a21f0 0x7f7c68066b00 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f7c58002f30 tx=0x7f7c58010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.382 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.370+0000 7f7c577fe700 1 -- 172.21.15.139:0/642358167 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c58005c00 con 0x7f7c680a21f0 2020-02-12T14:12:42.382 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.370+0000 7f7c70599700 1 -- 172.21.15.139:0/642358167 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c68148c30 con 0x7f7c680a21f0 2020-02-12T14:12:42.382 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.370+0000 7f7c6e335700 1 --2- 172.21.15.139:0/642358167 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c680a21f0 0x7f7c68066b00 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f7c58002f30 tx=0x7f7c58010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.382 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.371+0000 7f7c577fe700 1 -- 172.21.15.139:0/642358167 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f7c58007ab0 con 0x7f7c680a21f0 2020-02-12T14:12:42.382 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.371+0000 7f7c6e335700 1 --2- 172.21.15.139:0/642358167 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c680a21f0 0x7f7c68066b00 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f7c58002f30 tx=0x7f7c58010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.382 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.371+0000 7f7c70599700 1 -- 172.21.15.139:0/642358167 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c68067e20 con 0x7f7c680a21f0 2020-02-12T14:12:42.383 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.371+0000 7f7c577fe700 1 --2- 172.21.15.139:0/642358167 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f7c4803a320 0x7f7c4803c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:42.383 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.371+0000 7f7c577fe700 1 -- 172.21.15.139:0/642358167 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f7c58049010 con 0x7f7c680a21f0 2020-02-12T14:12:42.383 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.371+0000 7f7c6db34700 1 --2- 172.21.15.139:0/642358167 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f7c4803a320 0x7f7c4803c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:42.383 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.371+0000 7f7c6db34700 1 --2- 172.21.15.139:0/642358167 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f7c4803a320 0x7f7c4803c7e0 crc :-1 s=READY pgs=53 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:42.383 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.375+0000 7f7c6e335700 1 --2- 172.21.15.139:0/642358167 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c680a21f0 0x7f7c68066b00 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f7c58002f30 tx=0x7f7c58010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.383 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.375+0000 7f7c577fe700 1 -- 172.21.15.139:0/642358167 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f7c5802e700 con 0x7f7c680a21f0 2020-02-12T14:12:42.510 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.507+0000 7f7c70599700 1 -- 172.21.15.139:0/642358167 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c681360f0 con 0x7f7c680a21f0 2020-02-12T14:12:42.510 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.508+0000 7f7c6e335700 1 --2- 172.21.15.139:0/642358167 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c680a21f0 0x7f7c68066b00 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f7c58002f30 tx=0x7f7c58010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.510 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.508+0000 7f7c577fe700 1 -- 172.21.15.139:0/642358167 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f7c580311f0 con 0x7f7c680a21f0 2020-02-12T14:12:42.511 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 8 2020-02-12T14:12:42.512 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.510+0000 7f7c70599700 1 -- 172.21.15.139:0/642358167 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f7c4803a320 msgr2=0x7f7c4803c7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:42.512 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.510+0000 7f7c70599700 1 --2- 172.21.15.139:0/642358167 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f7c4803a320 0x7f7c4803c7e0 crc :-1 s=READY pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:42.512 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.510+0000 7f7c70599700 1 -- 172.21.15.139:0/642358167 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c680a21f0 msgr2=0x7f7c68066b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:42.512 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.510+0000 7f7c70599700 1 --2- 172.21.15.139:0/642358167 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c680a21f0 0x7f7c68066b00 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f7c58002f30 tx=0x7f7c58010960).stop 2020-02-12T14:12:42.513 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.510+0000 7f7c70599700 1 -- 172.21.15.139:0/642358167 shutdown_connections 2020-02-12T14:12:42.513 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.510+0000 7f7c70599700 1 --2- 172.21.15.139:0/642358167 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f7c4803a320 0x7f7c4803c7e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:42.513 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.510+0000 7f7c70599700 1 --2- 172.21.15.139:0/642358167 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c680a21f0 0x7f7c68066b00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:42.513 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.510+0000 7f7c70599700 1 -- 172.21.15.139:0/642358167 >> 172.21.15.139:0/642358167 conn(0x7f7c68060950 msgr2=0x7f7c680a5590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:42.513 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.510+0000 7f7c70599700 1 -- 172.21.15.139:0/642358167 shutdown_connections 2020-02-12T14:12:42.513 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.510+0000 7f7c70599700 1 -- 172.21.15.139:0/642358167 wait complete. 2020-02-12T14:12:42.522 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-02-12T14:12:42.629 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.627+0000 7ff9a485e700 1 Processor -- start 2020-02-12T14:12:42.629 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.627+0000 7ff9a485e700 1 -- start start 2020-02-12T14:12:42.632 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.628+0000 7ff9a485e700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff9a00a3f40 0x7ff9a0134df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:42.632 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.628+0000 7ff9a485e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9a00a24a0 0x7ff9a012e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:42.632 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.628+0000 7ff9a485e700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a01359e0 con 0x7ff9a0135250 2020-02-12T14:12:42.632 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.628+0000 7ff9a485e700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a0135c80 con 0x7ff9a00a3f40 2020-02-12T14:12:42.632 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.628+0000 7ff9a485e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a00a18f0 con 0x7ff9a00a24a0 2020-02-12T14:12:42.632 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.628+0000 7ff99e59c700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff9a00a3f40 0x7ff9a0134df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:42.633 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.628+0000 7ff99dd9b700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7ff9a0135250 0x7ff9a00a1d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35346/0 (socket says 172.21.15.139:35346) 2020-02-12T14:12:42.633 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.628+0000 7ff99dd9b700 1 -- 172.21.15.139:0/1199687630 learned_addr learned my addr 172.21.15.139:0/1199687630 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:42.633 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.628+0000 7ff99ed9d700 1 --2- 172.21.15.139:0/1199687630 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9a00a24a0 0x7ff9a012e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:42.633 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.628+0000 7ff99e59c700 1 -- 172.21.15.139:0/1199687630 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9a00a24a0 msgr2=0x7ff9a012e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:42.633 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.628+0000 7ff99e59c700 1 --2- 172.21.15.139:0/1199687630 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9a00a24a0 0x7ff9a012e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:42.633 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.628+0000 7ff99e59c700 1 -- 172.21.15.139:0/1199687630 >> v1:172.21.15.139:6789/0 conn(0x7ff9a0135250 legacy=0x7ff9a00a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:42.633 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.628+0000 7ff99e59c700 1 -- 172.21.15.139:0/1199687630 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a01356e0 con 0x7ff9a00a3f40 2020-02-12T14:12:42.633 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.628+0000 7ff99d59a700 1 -- 172.21.15.139:0/1199687630 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215499324 0 0) 0x7ff9a01359e0 con 0x7ff9a0135250 2020-02-12T14:12:42.634 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.628+0000 7ff99e59c700 1 --2- 172.21.15.139:0/1199687630 >> v2:172.21.15.139:3300/0 conn(0x7ff9a00a3f40 0x7ff9a0134df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff9980032b0 tx=0x7ff998008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.634 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.628+0000 7ff99e59c700 1 --2- 172.21.15.139:0/1199687630 >> v2:172.21.15.139:3300/0 conn(0x7ff9a00a3f40 0x7ff9a0134df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff9980032b0 tx=0x7ff998008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.634 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.628+0000 7ff99e59c700 1 --2- 172.21.15.139:0/1199687630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9a00a3f40 0x7ff9a0134df0 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7ff9980032b0 tx=0x7ff998008c60).ready entity=mon.1 client_cookie=10444c58a6cfad6b server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:42.634 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.628+0000 7ff99e59c700 1 --2- 172.21.15.139:0/1199687630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9a00a3f40 0x7ff9a0134df0 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7ff9980032b0 tx=0x7ff998008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.634 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.628+0000 7ff99d59a700 1 -- 172.21.15.139:0/1199687630 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff99800a160 con 0x7ff9a00a3f40 2020-02-12T14:12:42.634 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.628+0000 7ff99e59c700 1 --2- 172.21.15.139:0/1199687630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9a00a3f40 0x7ff9a0134df0 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7ff9980032b0 tx=0x7ff998008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.634 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.628+0000 7ff99d59a700 1 -- 172.21.15.139:0/1199687630 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99800a2c0 con 0x7ff9a00a3f40 2020-02-12T14:12:42.635 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.628+0000 7ff99e59c700 1 --2- 172.21.15.139:0/1199687630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9a00a3f40 0x7ff9a0134df0 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7ff9980032b0 tx=0x7ff998008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.635 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.628+0000 7ff99d59a700 1 -- 172.21.15.139:0/1199687630 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff99800a660 con 0x7ff9a00a3f40 2020-02-12T14:12:42.635 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.628+0000 7ff9a485e700 1 -- 172.21.15.139:0/1199687630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9a00a3f40 msgr2=0x7ff9a0134df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:42.635 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.628+0000 7ff9a485e700 1 --2- 172.21.15.139:0/1199687630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9a00a3f40 0x7ff9a0134df0 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7ff9980032b0 tx=0x7ff998008c60).stop 2020-02-12T14:12:42.635 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.629+0000 7ff9a485e700 1 -- 172.21.15.139:0/1199687630 shutdown_connections 2020-02-12T14:12:42.635 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.629+0000 7ff9a485e700 1 --2- 172.21.15.139:0/1199687630 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9a00a24a0 0x7ff9a012e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:42.635 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.629+0000 7ff9a485e700 1 --2- 172.21.15.139:0/1199687630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9a00a3f40 0x7ff9a0134df0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:42.635 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.629+0000 7ff9a485e700 1 -- 172.21.15.139:0/1199687630 >> 172.21.15.139:0/1199687630 conn(0x7ff9a0060950 msgr2=0x7ff9a009d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:42.635 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.629+0000 7ff9a485e700 1 -- 172.21.15.139:0/1199687630 shutdown_connections 2020-02-12T14:12:42.636 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.629+0000 7ff9a485e700 1 -- 172.21.15.139:0/1199687630 wait complete. 2020-02-12T14:12:42.636 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.630+0000 7ff9a485e700 1 Processor -- start 2020-02-12T14:12:42.636 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.630+0000 7ff9a485e700 1 -- start start 2020-02-12T14:12:42.639 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.630+0000 7ff9a485e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9a00a3f40 0x7ff9a009f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:42.639 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.630+0000 7ff9a485e700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff9a0135250 0x7ff9a012bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:42.639 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.630+0000 7ff9a485e700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a01383e0 con 0x7ff9a00a24a0 2020-02-12T14:12:42.639 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.630+0000 7ff9a485e700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a0138610 con 0x7ff9a0135250 2020-02-12T14:12:42.639 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.630+0000 7ff9a485e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a01388b0 con 0x7ff9a00a3f40 2020-02-12T14:12:42.639 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.630+0000 7ff99e59c700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7ff9a00a24a0 0x7ff9a012b5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35352/0 (socket says 172.21.15.139:35352) 2020-02-12T14:12:42.640 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.630+0000 7ff99e59c700 1 -- 172.21.15.139:0/1858574048 learned_addr learned my addr 172.21.15.139:0/1858574048 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:42.640 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.630+0000 7ff99ed9d700 1 --2- 172.21.15.139:0/1858574048 >> v2:172.21.15.139:3300/0 conn(0x7ff9a0135250 0x7ff9a012bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:42.640 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.631+0000 7ff99dd9b700 1 --2- 172.21.15.139:0/1858574048 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9a00a3f40 0x7ff9a009f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:42.640 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.631+0000 7ff9977fe700 1 -- 172.21.15.139:0/1858574048 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861938207 0 0) 0x7ff9a01383e0 con 0x7ff9a00a24a0 2020-02-12T14:12:42.640 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.631+0000 7ff9977fe700 1 -- 172.21.15.139:0/1858574048 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff984002fe0 con 0x7ff9a00a24a0 2020-02-12T14:12:42.640 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.631+0000 7ff99ed9d700 1 -- 172.21.15.139:0/1858574048 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9a00a3f40 msgr2=0x7ff9a009f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:42.640 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.631+0000 7ff99ed9d700 1 --2- 172.21.15.139:0/1858574048 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9a00a3f40 0x7ff9a009f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:42.641 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.631+0000 7ff99ed9d700 1 -- 172.21.15.139:0/1858574048 >> v1:172.21.15.139:6789/0 conn(0x7ff9a00a24a0 legacy=0x7ff9a012b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:42.641 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.631+0000 7ff99ed9d700 1 -- 172.21.15.139:0/1858574048 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a009ee00 con 0x7ff9a0135250 2020-02-12T14:12:42.641 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.631+0000 7ff99ed9d700 1 --2- 172.21.15.139:0/1858574048 >> v2:172.21.15.139:3300/0 conn(0x7ff9a0135250 0x7ff9a012bcf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff990002f30 tx=0x7ff990010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.641 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.631+0000 7ff99dd9b700 1 --2- 172.21.15.139:0/1858574048 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9a00a3f40 0x7ff9a009f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T14:12:42.641 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.631+0000 7ff99ed9d700 1 --2- 172.21.15.139:0/1858574048 >> v2:172.21.15.139:3300/0 conn(0x7ff9a0135250 0x7ff9a012bcf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff990002f30 tx=0x7ff990010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.641 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.631+0000 7ff99ed9d700 1 --2- 172.21.15.139:0/1858574048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9a0135250 0x7ff9a012bcf0 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7ff990002f30 tx=0x7ff990010b00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:42.641 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.631+0000 7ff99ed9d700 1 --2- 172.21.15.139:0/1858574048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9a0135250 0x7ff9a012bcf0 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7ff990002f30 tx=0x7ff990010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.641 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.631+0000 7ff9977fe700 1 -- 172.21.15.139:0/1858574048 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff990005aa0 con 0x7ff9a0135250 2020-02-12T14:12:42.642 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.631+0000 7ff99ed9d700 1 --2- 172.21.15.139:0/1858574048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9a0135250 0x7ff9a012bcf0 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7ff990002f30 tx=0x7ff990010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.642 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.631+0000 7ff99ed9d700 1 --2- 172.21.15.139:0/1858574048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9a0135250 0x7ff9a012bcf0 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7ff990002f30 tx=0x7ff990010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.642 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.631+0000 7ff9977fe700 1 -- 172.21.15.139:0/1858574048 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff990005c00 con 0x7ff9a0135250 2020-02-12T14:12:42.642 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.631+0000 7ff9a485e700 1 -- 172.21.15.139:0/1858574048 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a0135ee0 con 0x7ff9a0135250 2020-02-12T14:12:42.642 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.631+0000 7ff9977fe700 1 -- 172.21.15.139:0/1858574048 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff990012550 con 0x7ff9a0135250 2020-02-12T14:12:42.642 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.631+0000 7ff9a485e700 1 -- 172.21.15.139:0/1858574048 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a005b410 con 0x7ff9a0135250 2020-02-12T14:12:42.642 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.631+0000 7ff99ed9d700 1 --2- 172.21.15.139:0/1858574048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9a0135250 0x7ff9a012bcf0 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7ff990002f30 tx=0x7ff990010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.642 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.632+0000 7ff9977fe700 1 -- 172.21.15.139:0/1858574048 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7ff990007180 con 0x7ff9a0135250 2020-02-12T14:12:42.643 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.632+0000 7ff99ed9d700 1 --2- 172.21.15.139:0/1858574048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9a0135250 0x7ff9a012bcf0 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7ff990002f30 tx=0x7ff990010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.643 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.632+0000 7ff9977fe700 1 --2- 172.21.15.139:0/1858574048 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7ff984039f30 0x7ff98403c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:42.643 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.632+0000 7ff9977fe700 1 -- 172.21.15.139:0/1858574048 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7ff9900498d0 con 0x7ff9a0135250 2020-02-12T14:12:42.643 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.632+0000 7ff99e59c700 1 --2- 172.21.15.139:0/1858574048 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7ff984039f30 0x7ff98403c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:42.643 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.632+0000 7ff9a485e700 1 -- 172.21.15.139:0/1858574048 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a0067e20 con 0x7ff9a0135250 2020-02-12T14:12:42.643 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.632+0000 7ff99e59c700 1 --2- 172.21.15.139:0/1858574048 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7ff984039f30 0x7ff98403c3f0 crc :-1 s=READY pgs=54 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:42.643 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.636+0000 7ff99ed9d700 1 --2- 172.21.15.139:0/1858574048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9a0135250 0x7ff9a012bcf0 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7ff990002f30 tx=0x7ff990010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.644 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.636+0000 7ff9977fe700 1 -- 172.21.15.139:0/1858574048 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7ff99002ef00 con 0x7ff9a0135250 2020-02-12T14:12:42.773 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.771+0000 7ff9a485e700 1 -- 172.21.15.139:0/1858574048 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff9a0135030 con 0x7ff9a0135250 2020-02-12T14:12:42.773 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.771+0000 7ff99ed9d700 1 --2- 172.21.15.139:0/1858574048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9a0135250 0x7ff9a012bcf0 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7ff990002f30 tx=0x7ff990010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.774 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.771+0000 7ff9977fe700 1 -- 172.21.15.139:0/1858574048 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7ff990031a10 con 0x7ff9a0135250 2020-02-12T14:12:42.774 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 8 2020-02-12T14:12:42.775 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.772+0000 7ff9a485e700 1 -- 172.21.15.139:0/1858574048 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7ff984039f30 msgr2=0x7ff98403c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:42.775 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.772+0000 7ff9a485e700 1 --2- 172.21.15.139:0/1858574048 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7ff984039f30 0x7ff98403c3f0 crc :-1 s=READY pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:42.775 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.772+0000 7ff9a485e700 1 -- 172.21.15.139:0/1858574048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9a0135250 msgr2=0x7ff9a012bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:42.775 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.772+0000 7ff9a485e700 1 --2- 172.21.15.139:0/1858574048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9a0135250 0x7ff9a012bcf0 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7ff990002f30 tx=0x7ff990010b00).stop 2020-02-12T14:12:42.775 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.773+0000 7ff9a485e700 1 -- 172.21.15.139:0/1858574048 shutdown_connections 2020-02-12T14:12:42.776 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.773+0000 7ff9a485e700 1 --2- 172.21.15.139:0/1858574048 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7ff984039f30 0x7ff98403c3f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:42.776 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.773+0000 7ff9a485e700 1 --2- 172.21.15.139:0/1858574048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9a0135250 0x7ff9a012bcf0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:42.776 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.773+0000 7ff9a485e700 1 --2- 172.21.15.139:0/1858574048 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9a00a3f40 0x7ff9a009f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:42.776 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.773+0000 7ff9a485e700 1 -- 172.21.15.139:0/1858574048 >> 172.21.15.139:0/1858574048 conn(0x7ff9a0060950 msgr2=0x7ff9a00a5400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:42.776 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.773+0000 7ff9a485e700 1 -- 172.21.15.139:0/1858574048 shutdown_connections 2020-02-12T14:12:42.776 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.773+0000 7ff9a485e700 1 -- 172.21.15.139:0/1858574048 wait complete. 2020-02-12T14:12:42.785 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-02-12T14:12:42.785 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-02-12T14:12:42.785 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mgr dump --format=json 2020-02-12T14:12:42.890 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.887+0000 7f46aadd1700 1 Processor -- start 2020-02-12T14:12:42.890 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.887+0000 7f46aadd1700 1 -- start start 2020-02-12T14:12:42.892 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.888+0000 7f46aadd1700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f46a4140c40 0x7f46a4143030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:42.892 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.888+0000 7f46aadd1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a40a7c00 con 0x7f46a40a6190 2020-02-12T14:12:42.893 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.888+0000 7f46aadd1700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a40a7ea0 con 0x7f46a40a8340 2020-02-12T14:12:42.893 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.888+0000 7f46aadd1700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a40a7a10 con 0x7f46a4140c40 2020-02-12T14:12:42.893 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.888+0000 7f46a936e700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f46a4140c40 0x7f46a4143030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:42.893 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.888+0000 7f46a3fff700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f46a40a8340 0x7f46a4066040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35360/0 (socket says 172.21.15.139:35360) 2020-02-12T14:12:42.893 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.888+0000 7f46a936e700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f46a4140c40 0x7f46a4143030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46724/0 (socket says 172.21.15.139:46724) 2020-02-12T14:12:42.893 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.888+0000 7f46a3fff700 1 -- 172.21.15.139:0/4062540845 learned_addr learned my addr 172.21.15.139:0/4062540845 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:42.894 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.888+0000 7f46a936e700 1 -- 172.21.15.139:0/4062540845 >> v1:172.21.15.139:6789/0 conn(0x7f46a40a8340 legacy=0x7f46a4066040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:42.894 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.889+0000 7f46a936e700 1 -- 172.21.15.139:0/4062540845 >> v1:172.21.15.72:6789/0 conn(0x7f46a40a6190 legacy=0x7f46a4138130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:42.894 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.889+0000 7f46a936e700 1 -- 172.21.15.139:0/4062540845 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a4066750 con 0x7f46a4140c40 2020-02-12T14:12:42.894 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.889+0000 7f46a936e700 1 --2- 172.21.15.139:0/4062540845 >> v2:172.21.15.139:3300/0 conn(0x7f46a4140c40 0x7f46a4143030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f469c0032b0 tx=0x7f469c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.894 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.889+0000 7f46a936e700 1 --2- 172.21.15.139:0/4062540845 >> v2:172.21.15.139:3300/0 conn(0x7f46a4140c40 0x7f46a4143030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f469c0032b0 tx=0x7f469c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.894 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.889+0000 7f46a936e700 1 --2- 172.21.15.139:0/4062540845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46a4140c40 0x7f46a4143030 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f469c0032b0 tx=0x7f469c008c60).ready entity=mon.1 client_cookie=32cf7c12dc784de9 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:42.894 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.889+0000 7f46a936e700 1 --2- 172.21.15.139:0/4062540845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46a4140c40 0x7f46a4143030 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f469c0032b0 tx=0x7f469c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.894 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.889+0000 7f46a37fe700 1 -- 172.21.15.139:0/4062540845 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f469c00a160 con 0x7f46a4140c40 2020-02-12T14:12:42.895 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.889+0000 7f46a936e700 1 --2- 172.21.15.139:0/4062540845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46a4140c40 0x7f46a4143030 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f469c0032b0 tx=0x7f469c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.895 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.889+0000 7f46a37fe700 1 -- 172.21.15.139:0/4062540845 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c00a2c0 con 0x7f46a4140c40 2020-02-12T14:12:42.895 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.889+0000 7f46a936e700 1 --2- 172.21.15.139:0/4062540845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46a4140c40 0x7f46a4143030 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f469c0032b0 tx=0x7f469c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.895 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.889+0000 7f46a37fe700 1 -- 172.21.15.139:0/4062540845 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f469c00a6a0 con 0x7f46a4140c40 2020-02-12T14:12:42.895 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.889+0000 7f46aadd1700 1 -- 172.21.15.139:0/4062540845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46a4140c40 msgr2=0x7f46a4143030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:42.895 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.889+0000 7f46aadd1700 1 --2- 172.21.15.139:0/4062540845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46a4140c40 0x7f46a4143030 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f469c0032b0 tx=0x7f469c008c60).stop 2020-02-12T14:12:42.895 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.889+0000 7f46aadd1700 1 -- 172.21.15.139:0/4062540845 shutdown_connections 2020-02-12T14:12:42.895 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.889+0000 7f46aadd1700 1 --2- 172.21.15.139:0/4062540845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46a4140c40 0x7f46a4143030 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:42.896 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.889+0000 7f46aadd1700 1 -- 172.21.15.139:0/4062540845 >> 172.21.15.139:0/4062540845 conn(0x7f46a405fe70 msgr2=0x7f46a4069750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:42.896 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.889+0000 7f46aadd1700 1 -- 172.21.15.139:0/4062540845 shutdown_connections 2020-02-12T14:12:42.896 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.889+0000 7f46aadd1700 1 -- 172.21.15.139:0/4062540845 wait complete. 2020-02-12T14:12:42.896 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.890+0000 7f46aadd1700 1 Processor -- start 2020-02-12T14:12:42.896 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.890+0000 7f46aadd1700 1 -- start start 2020-02-12T14:12:42.899 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.891+0000 7f46aadd1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46a4140c40 0x7f46a4130920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:42.899 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.891+0000 7f46aadd1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a40a1dc0 con 0x7f46a40a6190 2020-02-12T14:12:42.899 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.891+0000 7f46aadd1700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a4130d80 con 0x7f46a40a8340 2020-02-12T14:12:42.900 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.891+0000 7f46aadd1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a40a4960 con 0x7f46a4140c40 2020-02-12T14:12:42.900 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.891+0000 7f46a3fff700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f46a40a8340 0x7f46a4130210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35366/0 (socket says 172.21.15.139:35366) 2020-02-12T14:12:42.900 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.891+0000 7f46a3fff700 1 -- 172.21.15.139:0/1680680207 learned_addr learned my addr 172.21.15.139:0/1680680207 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:42.900 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.891+0000 7f46a936e700 1 --2- 172.21.15.139:0/1680680207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46a4140c40 0x7f46a4130920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:42.900 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.891+0000 7f46a1ffb700 1 -- 172.21.15.139:0/1680680207 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1381565972 0 0) 0x7f46a40a7ea0 con 0x7f46a40a8340 2020-02-12T14:12:42.900 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.891+0000 7f46a1ffb700 1 -- 172.21.15.139:0/1680680207 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4684002fe0 con 0x7f46a40a8340 2020-02-12T14:12:42.900 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.891+0000 7f46a1ffb700 1 -- 172.21.15.139:0/1680680207 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597711416 0 0) 0x7f46a40a1dc0 con 0x7f46a40a6190 2020-02-12T14:12:42.902 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.891+0000 7f46a1ffb700 1 -- 172.21.15.139:0/1680680207 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46a40a7ea0 con 0x7f46a40a6190 2020-02-12T14:12:42.903 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.891+0000 7f46a1ffb700 1 -- 172.21.15.139:0/1680680207 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3681882999 0 0) 0x7f4684002fe0 con 0x7f46a40a8340 2020-02-12T14:12:42.903 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.891+0000 7f46a936e700 1 -- 172.21.15.139:0/1680680207 >> v1:172.21.15.139:6789/0 conn(0x7f46a40a8340 legacy=0x7f46a4130210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:42.903 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.892+0000 7f46a936e700 1 -- 172.21.15.139:0/1680680207 >> v1:172.21.15.72:6789/0 conn(0x7f46a40a6190 legacy=0x7f46a40a2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:42.903 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.892+0000 7f46a936e700 1 -- 172.21.15.139:0/1680680207 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a40a4c00 con 0x7f46a4140c40 2020-02-12T14:12:42.903 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.892+0000 7f46a936e700 1 --2- 172.21.15.139:0/1680680207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46a4140c40 0x7f46a4130920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f46a40a4f40 tx=0x7f46a4066940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.903 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.892+0000 7f46a936e700 1 --2- 172.21.15.139:0/1680680207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46a4140c40 0x7f46a4130920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f46a40a4f40 tx=0x7f46a4066940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.903 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.892+0000 7f46a936e700 1 --2- 172.21.15.139:0/1680680207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46a4140c40 0x7f46a4130920 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7f46a40a4f40 tx=0x7f46a4066940).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:42.904 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.892+0000 7f46a936e700 1 --2- 172.21.15.139:0/1680680207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46a4140c40 0x7f46a4130920 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f46a40a4f40 tx=0x7f46a4066940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.904 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.892+0000 7f46a1ffb700 1 -- 172.21.15.139:0/1680680207 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4698001850 con 0x7f46a4140c40 2020-02-12T14:12:42.904 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.892+0000 7f46a936e700 1 --2- 172.21.15.139:0/1680680207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46a4140c40 0x7f46a4130920 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f46a40a4f40 tx=0x7f46a4066940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.904 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.892+0000 7f46a936e700 1 --2- 172.21.15.139:0/1680680207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46a4140c40 0x7f46a4130920 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f46a40a4f40 tx=0x7f46a4066940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.904 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.892+0000 7f46a1ffb700 1 -- 172.21.15.139:0/1680680207 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c005a40 con 0x7f46a4140c40 2020-02-12T14:12:42.904 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.892+0000 7f46aadd1700 1 -- 172.21.15.139:0/1680680207 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a40a1ff0 con 0x7f46a4140c40 2020-02-12T14:12:42.904 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.892+0000 7f46a1ffb700 1 -- 172.21.15.139:0/1680680207 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f469c005da0 con 0x7f46a4140c40 2020-02-12T14:12:42.904 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.892+0000 7f46aadd1700 1 -- 172.21.15.139:0/1680680207 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a40a12f0 con 0x7f46a4140c40 2020-02-12T14:12:42.905 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.892+0000 7f46a936e700 1 --2- 172.21.15.139:0/1680680207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46a4140c40 0x7f46a4130920 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f46a40a4f40 tx=0x7f46a4066940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.905 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.893+0000 7f46a1ffb700 1 -- 172.21.15.139:0/1680680207 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f469c007150 con 0x7f46a4140c40 2020-02-12T14:12:42.905 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.893+0000 7f46a936e700 1 --2- 172.21.15.139:0/1680680207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46a4140c40 0x7f46a4130920 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f46a40a4f40 tx=0x7f46a4066940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.905 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.893+0000 7f46aadd1700 1 -- 172.21.15.139:0/1680680207 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a4067e20 con 0x7f46a4140c40 2020-02-12T14:12:42.905 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.893+0000 7f46a1ffb700 1 --2- 172.21.15.139:0/1680680207 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f468403a050 0x7f468403c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:42.905 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.893+0000 7f46a1ffb700 1 -- 172.21.15.139:0/1680680207 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f469c04a370 con 0x7f46a4140c40 2020-02-12T14:12:42.905 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.893+0000 7f46a8b6d700 1 --2- 172.21.15.139:0/1680680207 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f468403a050 0x7f468403c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:42.906 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.893+0000 7f46a8b6d700 1 --2- 172.21.15.139:0/1680680207 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f468403a050 0x7f468403c510 crc :-1 s=READY pgs=55 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:42.906 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.897+0000 7f46a936e700 1 --2- 172.21.15.139:0/1680680207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46a4140c40 0x7f46a4130920 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f46a40a4f40 tx=0x7f46a4066940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:42.906 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:42.897+0000 7f46a1ffb700 1 -- 172.21.15.139:0/1680680207 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f469c0329b0 con 0x7f46a4140c40 2020-02-12T14:12:43.067 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.065+0000 7f46aadd1700 1 -- 172.21.15.139:0/1680680207 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f46a405cb20 con 0x7f46a4140c40 2020-02-12T14:12:43.070 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.067+0000 7f46a936e700 1 --2- 172.21.15.139:0/1680680207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46a4140c40 0x7f46a4130920 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f46a40a4f40 tx=0x7f46a4066940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.071 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.067+0000 7f46a1ffb700 1 -- 172.21.15.139:0/1680680207 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+92794 (secure 0 0 0) 0x7f469c032570 con 0x7f46a4140c40 2020-02-12T14:12:43.071 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:12:43.072 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.069+0000 7f46aadd1700 1 -- 172.21.15.139:0/1680680207 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f468403a050 msgr2=0x7f468403c510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.072 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.069+0000 7f46aadd1700 1 --2- 172.21.15.139:0/1680680207 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f468403a050 0x7f468403c510 crc :-1 s=READY pgs=55 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.073 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.069+0000 7f46aadd1700 1 -- 172.21.15.139:0/1680680207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46a4140c40 msgr2=0x7f46a4130920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.073 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.069+0000 7f46aadd1700 1 --2- 172.21.15.139:0/1680680207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46a4140c40 0x7f46a4130920 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7f46a40a4f40 tx=0x7f46a4066940).stop 2020-02-12T14:12:43.073 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.069+0000 7f46aadd1700 1 -- 172.21.15.139:0/1680680207 shutdown_connections 2020-02-12T14:12:43.073 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.069+0000 7f46aadd1700 1 --2- 172.21.15.139:0/1680680207 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f468403a050 0x7f468403c510 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.073 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.069+0000 7f46aadd1700 1 --2- 172.21.15.139:0/1680680207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46a4140c40 0x7f46a4130920 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.073 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.069+0000 7f46aadd1700 1 -- 172.21.15.139:0/1680680207 >> 172.21.15.139:0/1680680207 conn(0x7f46a405fe70 msgr2=0x7f46a405e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:43.073 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.069+0000 7f46aadd1700 1 -- 172.21.15.139:0/1680680207 shutdown_connections 2020-02-12T14:12:43.074 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.069+0000 7f46aadd1700 1 -- 172.21.15.139:0/1680680207 wait complete. 2020-02-12T14:12:43.082 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":4,"active_gid":4108,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":21203},{"type":"v1","addr":"172.21.15.139:6801","nonce":21203}]},"active_addr":"172.21.15.139:6801/21203","active_change":"2020-02-12T14:12:21.139641+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if services are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_services":{"name":"warn_on_stray_services","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if services are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if services are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_services":{"name":"warn_on_stray_services","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if services are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator_cli","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.139:0","nonce":2275350561}]}]}} 2020-02-12T14:12:43.088 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-02-12T14:12:43.088 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-02-12T14:12:43.088 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-12T14:12:43.194 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.192+0000 7f6acd790700 1 Processor -- start 2020-02-12T14:12:43.195 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.192+0000 7f6acd790700 1 -- start start 2020-02-12T14:12:43.197 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.193+0000 7f6acd790700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6ac80a8340 0x7f6ac8066040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:43.198 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.193+0000 7f6acd790700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ac80664a0 0x7f6ac8134d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:43.198 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.193+0000 7f6acd790700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac80a7c00 con 0x7f6ac80a6190 2020-02-12T14:12:43.198 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.193+0000 7f6acd790700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac80a7a10 con 0x7f6ac80a8340 2020-02-12T14:12:43.198 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.193+0000 7f6acd790700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac8066950 con 0x7f6ac80664a0 2020-02-12T14:12:43.198 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.193+0000 7f6ac67fc700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6ac80a8340 0x7f6ac8066040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:43.198 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.193+0000 7f6ac6ffd700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f6ac80a6190 0x7f6ac8138130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35374/0 (socket says 172.21.15.139:35374) 2020-02-12T14:12:43.198 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.193+0000 7f6ac6ffd700 1 -- 172.21.15.139:0/692324061 learned_addr learned my addr 172.21.15.139:0/692324061 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:43.199 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.193+0000 7f6ac77fe700 1 --2- 172.21.15.139:0/692324061 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ac80664a0 0x7f6ac8134d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:43.199 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.193+0000 7f6ac67fc700 1 -- 172.21.15.139:0/692324061 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ac80664a0 msgr2=0x7f6ac8134d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:43.199 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.193+0000 7f6ac67fc700 1 --2- 172.21.15.139:0/692324061 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ac80664a0 0x7f6ac8134d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:43.199 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.193+0000 7f6ac67fc700 1 -- 172.21.15.139:0/692324061 >> v1:172.21.15.139:6789/0 conn(0x7f6ac80a6190 legacy=0x7f6ac8138130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.199 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.193+0000 7f6ac67fc700 1 -- 172.21.15.139:0/692324061 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac80a7ea0 con 0x7f6ac80a8340 2020-02-12T14:12:43.199 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.193+0000 7f6ac5ffb700 1 -- 172.21.15.139:0/692324061 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208309934 0 0) 0x7f6ac80a7c00 con 0x7f6ac80a6190 2020-02-12T14:12:43.199 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.193+0000 7f6ac67fc700 1 --2- 172.21.15.139:0/692324061 >> v2:172.21.15.139:3300/0 conn(0x7f6ac80a8340 0x7f6ac8066040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6ab8002f30 tx=0x7f6ab80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.199 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.193+0000 7f6ac67fc700 1 --2- 172.21.15.139:0/692324061 >> v2:172.21.15.139:3300/0 conn(0x7f6ac80a8340 0x7f6ac8066040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6ab8002f30 tx=0x7f6ab80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.200 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.194+0000 7f6ac67fc700 1 --2- 172.21.15.139:0/692324061 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ac80a8340 0x7f6ac8066040 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f6ab8002f30 tx=0x7f6ab80088e0).ready entity=mon.1 client_cookie=ebf7cb9082cf8d73 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:43.200 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.194+0000 7f6ac67fc700 1 --2- 172.21.15.139:0/692324061 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ac80a8340 0x7f6ac8066040 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f6ab8002f30 tx=0x7f6ab80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.200 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.194+0000 7f6ac5ffb700 1 -- 172.21.15.139:0/692324061 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ab8008e40 con 0x7f6ac80a8340 2020-02-12T14:12:43.200 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.194+0000 7f6ac67fc700 1 --2- 172.21.15.139:0/692324061 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ac80a8340 0x7f6ac8066040 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f6ab8002f30 tx=0x7f6ab80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.200 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.194+0000 7f6ac67fc700 1 --2- 172.21.15.139:0/692324061 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ac80a8340 0x7f6ac8066040 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f6ab8002f30 tx=0x7f6ab80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.200 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.194+0000 7f6ac5ffb700 1 -- 172.21.15.139:0/692324061 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab80116a0 con 0x7f6ac80a8340 2020-02-12T14:12:43.200 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.194+0000 7f6ac5ffb700 1 -- 172.21.15.139:0/692324061 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ab8011a40 con 0x7f6ac80a8340 2020-02-12T14:12:43.201 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.194+0000 7f6acd790700 1 -- 172.21.15.139:0/692324061 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ac80a8340 msgr2=0x7f6ac8066040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.201 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.194+0000 7f6acd790700 1 --2- 172.21.15.139:0/692324061 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ac80a8340 0x7f6ac8066040 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f6ab8002f30 tx=0x7f6ab80088e0).stop 2020-02-12T14:12:43.201 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.194+0000 7f6acd790700 1 -- 172.21.15.139:0/692324061 shutdown_connections 2020-02-12T14:12:43.201 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.194+0000 7f6acd790700 1 --2- 172.21.15.139:0/692324061 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ac80664a0 0x7f6ac8134d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:43.201 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.194+0000 7f6acd790700 1 --2- 172.21.15.139:0/692324061 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ac80a8340 0x7f6ac8066040 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.201 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.194+0000 7f6acd790700 1 -- 172.21.15.139:0/692324061 >> 172.21.15.139:0/692324061 conn(0x7f6ac805fe70 msgr2=0x7f6ac8069750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:43.201 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.194+0000 7f6acd790700 1 -- 172.21.15.139:0/692324061 shutdown_connections 2020-02-12T14:12:43.202 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.194+0000 7f6acd790700 1 -- 172.21.15.139:0/692324061 wait complete. 2020-02-12T14:12:43.202 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.195+0000 7f6acd790700 1 Processor -- start 2020-02-12T14:12:43.202 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.195+0000 7f6acd790700 1 -- start start 2020-02-12T14:12:43.205 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.196+0000 7f6acd790700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6ac80664a0 0x7f6ac8137c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:43.205 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.196+0000 7f6acd790700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6ac80a6190 0x7f6ac812fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:43.205 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.196+0000 7f6acd790700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac80a1230 con 0x7f6ac80a8340 2020-02-12T14:12:43.205 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.196+0000 7f6acd790700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac812f810 con 0x7f6ac80a6190 2020-02-12T14:12:43.205 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.196+0000 7f6acd790700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac80a14d0 con 0x7f6ac80664a0 2020-02-12T14:12:43.205 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.196+0000 7f6ac6ffd700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6ac80664a0 0x7f6ac8137c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:43.205 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.196+0000 7f6ac77fe700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f6ac80a8340 0x7f6ac812dd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35384/0 (socket says 172.21.15.139:35384) 2020-02-12T14:12:43.206 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.196+0000 7f6ac77fe700 1 -- 172.21.15.139:0/3525409894 learned_addr learned my addr 172.21.15.139:0/3525409894 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:43.206 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.196+0000 7f6ac67fc700 1 --2- 172.21.15.139:0/3525409894 >> v2:172.21.15.72:3300/0 conn(0x7f6ac80a6190 0x7f6ac812fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:43.206 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.196+0000 7f6ac6ffd700 1 -- 172.21.15.139:0/3525409894 >> v2:172.21.15.72:3300/0 conn(0x7f6ac80a6190 msgr2=0x7f6ac812fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.206 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.196+0000 7f6ac6ffd700 1 --2- 172.21.15.139:0/3525409894 >> v2:172.21.15.72:3300/0 conn(0x7f6ac80a6190 0x7f6ac812fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.206 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.196+0000 7f6ac6ffd700 1 -- 172.21.15.139:0/3525409894 >> v1:172.21.15.139:6789/0 conn(0x7f6ac80a8340 legacy=0x7f6ac812dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.206 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.196+0000 7f6ab7fff700 1 -- 172.21.15.139:0/3525409894 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1503653088 0 0) 0x7f6ac80a1230 con 0x7f6ac80a8340 2020-02-12T14:12:43.206 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.196+0000 7f6ac6ffd700 1 -- 172.21.15.139:0/3525409894 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac80a0eb0 con 0x7f6ac80664a0 2020-02-12T14:12:43.207 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.196+0000 7f6ac67fc700 1 --2- 172.21.15.139:0/3525409894 >> v2:172.21.15.72:3300/0 conn(0x7f6ac80a6190 0x7f6ac812fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T14:12:43.207 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.196+0000 7f6ac6ffd700 1 --2- 172.21.15.139:0/3525409894 >> v2:172.21.15.139:3300/0 conn(0x7f6ac80664a0 0x7f6ac8137c00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6abc000b80 tx=0x7f6abc0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.207 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.196+0000 7f6ac6ffd700 1 --2- 172.21.15.139:0/3525409894 >> v2:172.21.15.139:3300/0 conn(0x7f6ac80664a0 0x7f6ac8137c00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6abc000b80 tx=0x7f6abc0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.207 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.196+0000 7f6ac6ffd700 1 --2- 172.21.15.139:0/3525409894 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ac80664a0 0x7f6ac8137c00 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f6abc000b80 tx=0x7f6abc0109b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:43.207 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.196+0000 7f6ac6ffd700 1 --2- 172.21.15.139:0/3525409894 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ac80664a0 0x7f6ac8137c00 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f6abc000b80 tx=0x7f6abc0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.207 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.196+0000 7f6ab7fff700 1 -- 172.21.15.139:0/3525409894 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6abc005ca0 con 0x7f6ac80664a0 2020-02-12T14:12:43.207 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.196+0000 7f6ac6ffd700 1 --2- 172.21.15.139:0/3525409894 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ac80664a0 0x7f6ac8137c00 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f6abc000b80 tx=0x7f6abc0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.207 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.196+0000 7f6ab7fff700 1 -- 172.21.15.139:0/3525409894 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6abc005e00 con 0x7f6ac80664a0 2020-02-12T14:12:43.208 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.196+0000 7f6ac6ffd700 1 --2- 172.21.15.139:0/3525409894 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ac80664a0 0x7f6ac8137c00 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f6abc000b80 tx=0x7f6abc0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.208 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.196+0000 7f6acd790700 1 -- 172.21.15.139:0/3525409894 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac8130160 con 0x7f6ac80664a0 2020-02-12T14:12:43.208 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.196+0000 7f6ab7fff700 1 -- 172.21.15.139:0/3525409894 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6abc0062b0 con 0x7f6ac80664a0 2020-02-12T14:12:43.208 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.196+0000 7f6acd790700 1 -- 172.21.15.139:0/3525409894 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac809e010 con 0x7f6ac80664a0 2020-02-12T14:12:43.208 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.197+0000 7f6ac6ffd700 1 --2- 172.21.15.139:0/3525409894 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ac80664a0 0x7f6ac8137c00 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f6abc000b80 tx=0x7f6abc0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.208 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.197+0000 7f6ab7fff700 1 -- 172.21.15.139:0/3525409894 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f6abc006530 con 0x7f6ac80664a0 2020-02-12T14:12:43.208 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.197+0000 7f6ac6ffd700 1 --2- 172.21.15.139:0/3525409894 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ac80664a0 0x7f6ac8137c00 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f6abc000b80 tx=0x7f6abc0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.209 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.197+0000 7f6acd790700 1 -- 172.21.15.139:0/3525409894 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac8067e20 con 0x7f6ac80664a0 2020-02-12T14:12:43.209 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.197+0000 7f6ab7fff700 1 --2- 172.21.15.139:0/3525409894 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f6aa4039a30 0x7f6aa403bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:43.209 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.197+0000 7f6ab7fff700 1 -- 172.21.15.139:0/3525409894 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f6abc049910 con 0x7f6ac80664a0 2020-02-12T14:12:43.209 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.197+0000 7f6ac67fc700 1 --2- 172.21.15.139:0/3525409894 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f6aa4039a30 0x7f6aa403bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:43.209 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.198+0000 7f6ac67fc700 1 --2- 172.21.15.139:0/3525409894 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f6aa4039a30 0x7f6aa403bef0 crc :-1 s=READY pgs=57 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:43.209 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.201+0000 7f6ac6ffd700 1 --2- 172.21.15.139:0/3525409894 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ac80664a0 0x7f6ac8137c00 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f6abc000b80 tx=0x7f6abc0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.209 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.201+0000 7f6ab7fff700 1 -- 172.21.15.139:0/3525409894 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f6abc02efa0 con 0x7f6ac80664a0 2020-02-12T14:12:43.339 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.337+0000 7f6acd790700 1 -- 172.21.15.139:0/3525409894 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ac812f950 con 0x7f6ac80664a0 2020-02-12T14:12:43.340 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.338+0000 7f6ac6ffd700 1 --2- 172.21.15.139:0/3525409894 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ac80664a0 0x7f6ac8137c00 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f6abc000b80 tx=0x7f6abc0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.340 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.338+0000 7f6ab7fff700 1 -- 172.21.15.139:0/3525409894 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14933 (secure 0 0 0) 0x7f6abc031a90 con 0x7f6ac80664a0 2020-02-12T14:12:43.340 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:12:43.341 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":23,"fsid":"dacc9a6c-9e88-46ac-940b-c4a329dbffec","created":"2020-02-12T14:12:18.258232+0000","modified":"2020-02-12T14:12:39.447885+0000","last_up_change":"2020-02-12T14:12:27.050924+0000","last_in_change":"2020-02-12T14:12:27.050924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-12T14:12:31.091380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-02-12T14:12:34.160095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-02-12T14:12:37.119732+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffc0664d-9b93-45a4-a454-7655ee26d582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":22147},{"type":"v1","addr":"172.21.15.139:6803","nonce":22147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":22147},{"type":"v1","addr":"172.21.15.139:6805","nonce":22147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":22147},{"type":"v1","addr":"172.21.15.139:6809","nonce":22147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":22147},{"type":"v1","addr":"172.21.15.139:6807","nonce":22147}]},"public_addr":"172.21.15.139:6803/22147","cluster_addr":"172.21.15.139:6805/22147","heartbeat_back_addr":"172.21.15.139:6809/22147","heartbeat_front_addr":"172.21.15.139:6807/22147","state":["exists","up"]},{"osd":1,"uuid":"f66da6bc-43b3-4846-85f9-a25e3fe95216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":22148},{"type":"v1","addr":"172.21.15.139:6811","nonce":22148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":22148},{"type":"v1","addr":"172.21.15.139:6813","nonce":22148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6819","nonce":22148},{"type":"v1","addr":"172.21.15.139:6821","nonce":22148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6815","nonce":22148},{"type":"v1","addr":"172.21.15.139:6817","nonce":22148}]},"public_addr":"172.21.15.139:6811/22148","cluster_addr":"172.21.15.139:6813/22148","heartbeat_back_addr":"172.21.15.139:6821/22148","heartbeat_front_addr":"172.21.15.139:6817/22148","state":["exists","up"]},{"osd":2,"uuid":"c35fb293-3e16-41e8-85f3-768e11e55b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":22149},{"type":"v1","addr":"172.21.15.139:6827","nonce":22149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":22149},{"type":"v1","addr":"172.21.15.139:6829","nonce":22149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":22149},{"type":"v1","addr":"172.21.15.139:6833","nonce":22149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":22149},{"type":"v1","addr":"172.21.15.139:6831","nonce":22149}]},"public_addr":"172.21.15.139:6827/22149","cluster_addr":"172.21.15.139:6829/22149","heartbeat_back_addr":"172.21.15.139:6833/22149","heartbeat_front_addr":"172.21.15.139:6831/22149","state":["exists","up"]},{"osd":3,"uuid":"bc8b2c0d-e3dd-48cb-883e-6ea965aee923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":22150},{"type":"v1","addr":"172.21.15.139:6816","nonce":22150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":22150},{"type":"v1","addr":"172.21.15.139:6820","nonce":22150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":22150},{"type":"v1","addr":"172.21.15.139:6825","nonce":22150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":22150},{"type":"v1","addr":"172.21.15.139:6823","nonce":22150}]},"public_addr":"172.21.15.139:6816/22150","cluster_addr":"172.21.15.139:6820/22150","heartbeat_back_addr":"172.21.15.139:6825/22150","heartbeat_front_addr":"172.21.15.139:6823/22150","state":["exists","up"]},{"osd":4,"uuid":"aadfc406-0c40-4b6b-9e19-c92b2f40264a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":21598},{"type":"v1","addr":"172.21.15.72:6801","nonce":21598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":21598},{"type":"v1","addr":"172.21.15.72:6803","nonce":21598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":21598},{"type":"v1","addr":"172.21.15.72:6807","nonce":21598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":21598},{"type":"v1","addr":"172.21.15.72:6805","nonce":21598}]},"public_addr":"172.21.15.72:6801/21598","cluster_addr":"172.21.15.72:6803/21598","heartbeat_back_addr":"172.21.15.72:6807/21598","heartbeat_front_addr":"172.21.15.72:6805/21598","state":["exists","up"]},{"osd":5,"uuid":"3296dc8e-9322-4430-abd2-7672da5b7acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":21599},{"type":"v1","addr":"172.21.15.72:6810","nonce":21599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":21599},{"type":"v1","addr":"172.21.15.72:6815","nonce":21599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":21599},{"type":"v1","addr":"172.21.15.72:6823","nonce":21599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":21599},{"type":"v1","addr":"172.21.15.72:6820","nonce":21599}]},"public_addr":"172.21.15.72:6810/21599","cluster_addr":"172.21.15.72:6815/21599","heartbeat_back_addr":"172.21.15.72:6823/21599","heartbeat_front_addr":"172.21.15.72:6820/21599","state":["exists","up"]},{"osd":6,"uuid":"7c39cf20-a3a8-4d56-8577-f4102b302a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":21601},{"type":"v1","addr":"172.21.15.72:6811","nonce":21601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":21601},{"type":"v1","addr":"172.21.15.72:6814","nonce":21601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":21601},{"type":"v1","addr":"172.21.15.72:6821","nonce":21601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":21601},{"type":"v1","addr":"172.21.15.72:6818","nonce":21601}]},"public_addr":"172.21.15.72:6811/21601","cluster_addr":"172.21.15.72:6814/21601","heartbeat_back_addr":"172.21.15.72:6821/21601","heartbeat_front_addr":"172.21.15.72:6818/21601","state":["exists","up"]},{"osd":7,"uuid":"f452adff-8432-47e9-a5f1-9fd7e2a04a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":21600},{"type":"v1","addr":"172.21.15.72:6825","nonce":21600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":21600},{"type":"v1","addr":"172.21.15.72:6827","nonce":21600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":21600},{"type":"v1","addr":"172.21.15.72:6831","nonce":21600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":21600},{"type":"v1","addr":"172.21.15.72:6829","nonce":21600}]},"public_addr":"172.21.15.72:6825/21600","cluster_addr":"172.21.15.72:6827/21600","heartbeat_back_addr":"172.21.15.72:6831/21600","heartbeat_front_addr":"172.21.15.72:6829/21600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.259782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.267019+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.315501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.326256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.335328+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.284130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.083179+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.351445+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-12T14:12:43.342 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.339+0000 7f6acd790700 1 -- 172.21.15.139:0/3525409894 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f6aa4039a30 msgr2=0x7f6aa403bef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.342 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.339+0000 7f6acd790700 1 --2- 172.21.15.139:0/3525409894 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f6aa4039a30 0x7f6aa403bef0 crc :-1 s=READY pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.342 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.339+0000 7f6acd790700 1 -- 172.21.15.139:0/3525409894 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ac80664a0 msgr2=0x7f6ac8137c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.342 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.339+0000 7f6acd790700 1 --2- 172.21.15.139:0/3525409894 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ac80664a0 0x7f6ac8137c00 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f6abc000b80 tx=0x7f6abc0109b0).stop 2020-02-12T14:12:43.342 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.339+0000 7f6acd790700 1 -- 172.21.15.139:0/3525409894 shutdown_connections 2020-02-12T14:12:43.342 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.339+0000 7f6acd790700 1 --2- 172.21.15.139:0/3525409894 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f6aa4039a30 0x7f6aa403bef0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.343 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.339+0000 7f6acd790700 1 --2- 172.21.15.139:0/3525409894 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ac80664a0 0x7f6ac8137c00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.343 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.339+0000 7f6acd790700 1 --2- 172.21.15.139:0/3525409894 >> v2:172.21.15.72:3300/0 conn(0x7f6ac80a6190 0x7f6ac812fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.343 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.339+0000 7f6acd790700 1 -- 172.21.15.139:0/3525409894 >> 172.21.15.139:0/3525409894 conn(0x7f6ac805fe70 msgr2=0x7f6ac8134850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:43.343 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.339+0000 7f6acd790700 1 -- 172.21.15.139:0/3525409894 shutdown_connections 2020-02-12T14:12:43.343 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.339+0000 7f6acd790700 1 -- 172.21.15.139:0/3525409894 wait complete. 2020-02-12T14:12:43.352 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-02-12T14:12:43.352 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-12T14:12:43.458 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.455+0000 7f92b12f8700 1 Processor -- start 2020-02-12T14:12:43.458 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.455+0000 7f92b12f8700 1 -- start start 2020-02-12T14:12:43.464 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.456+0000 7f92b12f8700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f92ac0a3f40 0x7f92ac134df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:43.464 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.456+0000 7f92b12f8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f92ac0a24a0 0x7f92ac12e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:43.465 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.456+0000 7f92b12f8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ac1359e0 con 0x7f92ac135250 2020-02-12T14:12:43.465 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.456+0000 7f92b12f8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92ac135c80 con 0x7f92ac0a24a0 2020-02-12T14:12:43.465 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.456+0000 7f92b12f8700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92ac0a18f0 con 0x7f92ac0a3f40 2020-02-12T14:12:43.465 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.456+0000 7f92aaffd700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f92ac0a3f40 0x7f92ac134df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:43.465 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.456+0000 7f92aaffd700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f92ac0a3f40 0x7f92ac134df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46750/0 (socket says 172.21.15.139:46750) 2020-02-12T14:12:43.465 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.456+0000 7f92aaffd700 1 -- 172.21.15.139:0/955398356 learned_addr learned my addr 172.21.15.139:0/955398356 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:43.466 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.457+0000 7f92ab7fe700 1 --2- 172.21.15.139:0/955398356 >> v2:172.21.15.72:3300/0 conn(0x7f92ac0a24a0 0x7f92ac12e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:43.466 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.457+0000 7f92aaffd700 1 -- 172.21.15.139:0/955398356 >> v2:172.21.15.72:3300/0 conn(0x7f92ac0a24a0 msgr2=0x7f92ac12e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:43.466 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.457+0000 7f92aaffd700 1 --2- 172.21.15.139:0/955398356 >> v2:172.21.15.72:3300/0 conn(0x7f92ac0a24a0 0x7f92ac12e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:43.466 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.457+0000 7f92aaffd700 1 -- 172.21.15.139:0/955398356 >> v1:172.21.15.72:6789/0 conn(0x7f92ac135250 legacy=0x7f92ac0a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:43.466 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.457+0000 7f92aaffd700 1 -- 172.21.15.139:0/955398356 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ac1356e0 con 0x7f92ac0a3f40 2020-02-12T14:12:43.466 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.457+0000 7f92aaffd700 1 --2- 172.21.15.139:0/955398356 >> v2:172.21.15.139:3300/0 conn(0x7f92ac0a3f40 0x7f92ac134df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f92ac060f00 tx=0x7f9294007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.466 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.457+0000 7f92aaffd700 1 --2- 172.21.15.139:0/955398356 >> v2:172.21.15.139:3300/0 conn(0x7f92ac0a3f40 0x7f92ac134df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f92ac060f00 tx=0x7f9294007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.466 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.457+0000 7f92aaffd700 1 --2- 172.21.15.139:0/955398356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ac0a3f40 0x7f92ac134df0 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7f92ac060f00 tx=0x7f9294007a40).ready entity=mon.1 client_cookie=b6552e81cb6ebfcc server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:43.467 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.457+0000 7f92aaffd700 1 --2- 172.21.15.139:0/955398356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ac0a3f40 0x7f92ac134df0 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f92ac060f00 tx=0x7f9294007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.467 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.457+0000 7f92a9ffb700 1 -- 172.21.15.139:0/955398356 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92940116e0 con 0x7f92ac0a3f40 2020-02-12T14:12:43.467 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.457+0000 7f92aaffd700 1 --2- 172.21.15.139:0/955398356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ac0a3f40 0x7f92ac134df0 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f92ac060f00 tx=0x7f9294007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.467 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.457+0000 7f92a9ffb700 1 -- 172.21.15.139:0/955398356 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9294011840 con 0x7f92ac0a3f40 2020-02-12T14:12:43.467 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.457+0000 7f92aaffd700 1 --2- 172.21.15.139:0/955398356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ac0a3f40 0x7f92ac134df0 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f92ac060f00 tx=0x7f9294007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.467 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.457+0000 7f92a9ffb700 1 -- 172.21.15.139:0/955398356 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9294011c20 con 0x7f92ac0a3f40 2020-02-12T14:12:43.467 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.457+0000 7f92b12f8700 1 -- 172.21.15.139:0/955398356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ac0a3f40 msgr2=0x7f92ac134df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.467 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.457+0000 7f92b12f8700 1 --2- 172.21.15.139:0/955398356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ac0a3f40 0x7f92ac134df0 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7f92ac060f00 tx=0x7f9294007a40).stop 2020-02-12T14:12:43.468 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.458+0000 7f92b12f8700 1 -- 172.21.15.139:0/955398356 shutdown_connections 2020-02-12T14:12:43.468 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.458+0000 7f92b12f8700 1 --2- 172.21.15.139:0/955398356 >> v2:172.21.15.72:3300/0 conn(0x7f92ac0a24a0 0x7f92ac12e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:43.468 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.458+0000 7f92b12f8700 1 --2- 172.21.15.139:0/955398356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ac0a3f40 0x7f92ac134df0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.468 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.458+0000 7f92b12f8700 1 -- 172.21.15.139:0/955398356 >> 172.21.15.139:0/955398356 conn(0x7f92ac060950 msgr2=0x7f92ac09d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:43.468 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.458+0000 7f92b12f8700 1 -- 172.21.15.139:0/955398356 shutdown_connections 2020-02-12T14:12:43.468 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.458+0000 7f92b12f8700 1 -- 172.21.15.139:0/955398356 wait complete. 2020-02-12T14:12:43.468 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.458+0000 7f92b12f8700 1 Processor -- start 2020-02-12T14:12:43.468 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.458+0000 7f92b12f8700 1 -- start start 2020-02-12T14:12:43.469 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.459+0000 7f92b12f8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f92ac0a3f40 0x7f92ac12b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:43.469 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.459+0000 7f92b12f8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ac132710 con 0x7f92ac135250 2020-02-12T14:12:43.469 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.459+0000 7f92b12f8700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ac0671d0 con 0x7f92ac0a24a0 2020-02-12T14:12:43.469 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.459+0000 7f92b12f8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92ac135fd0 con 0x7f92ac0a3f40 2020-02-12T14:12:43.469 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.459+0000 7f92aaffd700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f92ac0a24a0 0x7f92ac137b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35394/0 (socket says 172.21.15.139:35394) 2020-02-12T14:12:43.469 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.459+0000 7f92aaffd700 1 -- 172.21.15.139:0/4207657126 learned_addr learned my addr 172.21.15.139:0/4207657126 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:43.469 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.459+0000 7f92aa7fc700 1 --2- 172.21.15.139:0/4207657126 >> v2:172.21.15.72:3300/0 conn(0x7f92ac0a3f40 0x7f92ac12b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:43.469 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.459+0000 7f92a3fff700 1 -- 172.21.15.139:0/4207657126 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 588322298 0 0) 0x7f92ac0671d0 con 0x7f92ac0a24a0 2020-02-12T14:12:43.470 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.459+0000 7f92a3fff700 1 -- 172.21.15.139:0/4207657126 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9290002fe0 con 0x7f92ac0a24a0 2020-02-12T14:12:43.470 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.459+0000 7f92a3fff700 1 -- 172.21.15.139:0/4207657126 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1768727410 0 0) 0x7f9290002fe0 con 0x7f92ac0a24a0 2020-02-12T14:12:43.470 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.460+0000 7f92a3fff700 1 -- 172.21.15.139:0/4207657126 --> v1:172.21.15.139:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f92ac0671d0 con 0x7f92ac0a24a0 2020-02-12T14:12:43.470 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.460+0000 7f92a3fff700 1 -- 172.21.15.139:0/4207657126 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7f92940085c0 con 0x7f92ac0a24a0 2020-02-12T14:12:43.470 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.460+0000 7f92aa7fc700 1 -- 172.21.15.139:0/4207657126 >> v1:172.21.15.139:6789/0 conn(0x7f92ac0a24a0 legacy=0x7f92ac137b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.470 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.460+0000 7f92aa7fc700 1 -- 172.21.15.139:0/4207657126 >> v1:172.21.15.72:6789/0 conn(0x7f92ac135250 legacy=0x7f92ac14db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.470 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.460+0000 7f92aa7fc700 1 -- 172.21.15.139:0/4207657126 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ac137910 con 0x7f92ac0a3f40 2020-02-12T14:12:43.471 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.460+0000 7f92aa7fc700 1 --2- 172.21.15.139:0/4207657126 >> v2:172.21.15.72:3300/0 conn(0x7f92ac0a3f40 0x7f92ac12b780 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f92a4007ca0 tx=0x7f929c010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.471 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.460+0000 7f92aa7fc700 1 --2- 172.21.15.139:0/4207657126 >> v2:172.21.15.72:3300/0 conn(0x7f92ac0a3f40 0x7f92ac12b780 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f92a4007ca0 tx=0x7f929c010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.471 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.460+0000 7f92aa7fc700 1 --2- 172.21.15.139:0/4207657126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac0a3f40 0x7f92ac12b780 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f92a4007ca0 tx=0x7f929c010800).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:43.471 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.460+0000 7f92aa7fc700 1 --2- 172.21.15.139:0/4207657126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac0a3f40 0x7f92ac12b780 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f92a4007ca0 tx=0x7f929c010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.471 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.460+0000 7f92a3fff700 1 -- 172.21.15.139:0/4207657126 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f929c0069b0 con 0x7f92ac0a3f40 2020-02-12T14:12:43.471 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.460+0000 7f92aa7fc700 1 --2- 172.21.15.139:0/4207657126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac0a3f40 0x7f92ac12b780 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f92a4007ca0 tx=0x7f929c010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.471 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.460+0000 7f92a3fff700 1 -- 172.21.15.139:0/4207657126 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929c006b10 con 0x7f92ac0a3f40 2020-02-12T14:12:43.471 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.460+0000 7f92aa7fc700 1 --2- 172.21.15.139:0/4207657126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac0a3f40 0x7f92ac12b780 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f92a4007ca0 tx=0x7f929c010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.472 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.460+0000 7f92b12f8700 1 -- 172.21.15.139:0/4207657126 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92ac09ebd0 con 0x7f92ac0a3f40 2020-02-12T14:12:43.472 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.460+0000 7f92a3fff700 1 -- 172.21.15.139:0/4207657126 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f929c003070 con 0x7f92ac0a3f40 2020-02-12T14:12:43.472 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.460+0000 7f92b12f8700 1 -- 172.21.15.139:0/4207657126 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ac1375d0 con 0x7f92ac0a3f40 2020-02-12T14:12:43.472 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.461+0000 7f92aa7fc700 1 --2- 172.21.15.139:0/4207657126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac0a3f40 0x7f92ac12b780 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f92a4007ca0 tx=0x7f929c010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.472 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.461+0000 7f92b12f8700 1 -- 172.21.15.139:0/4207657126 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ac132570 con 0x7f92ac0a3f40 2020-02-12T14:12:43.472 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.461+0000 7f92a3fff700 1 -- 172.21.15.139:0/4207657126 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f929c003270 con 0x7f92ac0a3f40 2020-02-12T14:12:43.472 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.461+0000 7f92aa7fc700 1 --2- 172.21.15.139:0/4207657126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac0a3f40 0x7f92ac12b780 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f92a4007ca0 tx=0x7f929c010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.472 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.461+0000 7f92a3fff700 1 --2- 172.21.15.139:0/4207657126 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f929003a150 0x7f929003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:43.473 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.461+0000 7f92a3fff700 1 -- 172.21.15.139:0/4207657126 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f929c002e40 con 0x7f92ac0a3f40 2020-02-12T14:12:43.473 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.461+0000 7f92aaffd700 1 --2- 172.21.15.139:0/4207657126 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f929003a150 0x7f929003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:43.473 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.461+0000 7f92aaffd700 1 --2- 172.21.15.139:0/4207657126 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f929003a150 0x7f929003c610 crc :-1 s=READY pgs=58 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:43.473 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.465+0000 7f92aa7fc700 1 --2- 172.21.15.139:0/4207657126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac0a3f40 0x7f92ac12b780 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f92a4007ca0 tx=0x7f929c010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.473 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.465+0000 7f92a3fff700 1 -- 172.21.15.139:0/4207657126 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f92ac132570 con 0x7f92ac0a3f40 2020-02-12T14:12:43.601 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.599+0000 7f92b12f8700 1 -- 172.21.15.139:0/4207657126 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92ac132570 con 0x7f92ac0a3f40 2020-02-12T14:12:43.602 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.601+0000 7f92aa7fc700 1 --2- 172.21.15.139:0/4207657126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac0a3f40 0x7f92ac12b780 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f92a4007ca0 tx=0x7f929c010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.603 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.601+0000 7f92a3fff700 1 -- 172.21.15.139:0/4207657126 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14933 (secure 0 0 0) 0x7f92ac132570 con 0x7f92ac0a3f40 2020-02-12T14:12:43.603 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:12:43.603 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":23,"fsid":"dacc9a6c-9e88-46ac-940b-c4a329dbffec","created":"2020-02-12T14:12:18.258232+0000","modified":"2020-02-12T14:12:39.447885+0000","last_up_change":"2020-02-12T14:12:27.050924+0000","last_in_change":"2020-02-12T14:12:27.050924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-12T14:12:31.091380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-02-12T14:12:34.160095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-02-12T14:12:37.119732+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffc0664d-9b93-45a4-a454-7655ee26d582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":22147},{"type":"v1","addr":"172.21.15.139:6803","nonce":22147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":22147},{"type":"v1","addr":"172.21.15.139:6805","nonce":22147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":22147},{"type":"v1","addr":"172.21.15.139:6809","nonce":22147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":22147},{"type":"v1","addr":"172.21.15.139:6807","nonce":22147}]},"public_addr":"172.21.15.139:6803/22147","cluster_addr":"172.21.15.139:6805/22147","heartbeat_back_addr":"172.21.15.139:6809/22147","heartbeat_front_addr":"172.21.15.139:6807/22147","state":["exists","up"]},{"osd":1,"uuid":"f66da6bc-43b3-4846-85f9-a25e3fe95216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":22148},{"type":"v1","addr":"172.21.15.139:6811","nonce":22148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":22148},{"type":"v1","addr":"172.21.15.139:6813","nonce":22148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6819","nonce":22148},{"type":"v1","addr":"172.21.15.139:6821","nonce":22148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6815","nonce":22148},{"type":"v1","addr":"172.21.15.139:6817","nonce":22148}]},"public_addr":"172.21.15.139:6811/22148","cluster_addr":"172.21.15.139:6813/22148","heartbeat_back_addr":"172.21.15.139:6821/22148","heartbeat_front_addr":"172.21.15.139:6817/22148","state":["exists","up"]},{"osd":2,"uuid":"c35fb293-3e16-41e8-85f3-768e11e55b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":22149},{"type":"v1","addr":"172.21.15.139:6827","nonce":22149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":22149},{"type":"v1","addr":"172.21.15.139:6829","nonce":22149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":22149},{"type":"v1","addr":"172.21.15.139:6833","nonce":22149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":22149},{"type":"v1","addr":"172.21.15.139:6831","nonce":22149}]},"public_addr":"172.21.15.139:6827/22149","cluster_addr":"172.21.15.139:6829/22149","heartbeat_back_addr":"172.21.15.139:6833/22149","heartbeat_front_addr":"172.21.15.139:6831/22149","state":["exists","up"]},{"osd":3,"uuid":"bc8b2c0d-e3dd-48cb-883e-6ea965aee923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":22150},{"type":"v1","addr":"172.21.15.139:6816","nonce":22150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":22150},{"type":"v1","addr":"172.21.15.139:6820","nonce":22150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":22150},{"type":"v1","addr":"172.21.15.139:6825","nonce":22150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":22150},{"type":"v1","addr":"172.21.15.139:6823","nonce":22150}]},"public_addr":"172.21.15.139:6816/22150","cluster_addr":"172.21.15.139:6820/22150","heartbeat_back_addr":"172.21.15.139:6825/22150","heartbeat_front_addr":"172.21.15.139:6823/22150","state":["exists","up"]},{"osd":4,"uuid":"aadfc406-0c40-4b6b-9e19-c92b2f40264a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":21598},{"type":"v1","addr":"172.21.15.72:6801","nonce":21598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":21598},{"type":"v1","addr":"172.21.15.72:6803","nonce":21598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":21598},{"type":"v1","addr":"172.21.15.72:6807","nonce":21598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":21598},{"type":"v1","addr":"172.21.15.72:6805","nonce":21598}]},"public_addr":"172.21.15.72:6801/21598","cluster_addr":"172.21.15.72:6803/21598","heartbeat_back_addr":"172.21.15.72:6807/21598","heartbeat_front_addr":"172.21.15.72:6805/21598","state":["exists","up"]},{"osd":5,"uuid":"3296dc8e-9322-4430-abd2-7672da5b7acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":21599},{"type":"v1","addr":"172.21.15.72:6810","nonce":21599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":21599},{"type":"v1","addr":"172.21.15.72:6815","nonce":21599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":21599},{"type":"v1","addr":"172.21.15.72:6823","nonce":21599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":21599},{"type":"v1","addr":"172.21.15.72:6820","nonce":21599}]},"public_addr":"172.21.15.72:6810/21599","cluster_addr":"172.21.15.72:6815/21599","heartbeat_back_addr":"172.21.15.72:6823/21599","heartbeat_front_addr":"172.21.15.72:6820/21599","state":["exists","up"]},{"osd":6,"uuid":"7c39cf20-a3a8-4d56-8577-f4102b302a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":21601},{"type":"v1","addr":"172.21.15.72:6811","nonce":21601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":21601},{"type":"v1","addr":"172.21.15.72:6814","nonce":21601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":21601},{"type":"v1","addr":"172.21.15.72:6821","nonce":21601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":21601},{"type":"v1","addr":"172.21.15.72:6818","nonce":21601}]},"public_addr":"172.21.15.72:6811/21601","cluster_addr":"172.21.15.72:6814/21601","heartbeat_back_addr":"172.21.15.72:6821/21601","heartbeat_front_addr":"172.21.15.72:6818/21601","state":["exists","up"]},{"osd":7,"uuid":"f452adff-8432-47e9-a5f1-9fd7e2a04a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":21600},{"type":"v1","addr":"172.21.15.72:6825","nonce":21600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":21600},{"type":"v1","addr":"172.21.15.72:6827","nonce":21600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":21600},{"type":"v1","addr":"172.21.15.72:6831","nonce":21600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":21600},{"type":"v1","addr":"172.21.15.72:6829","nonce":21600}]},"public_addr":"172.21.15.72:6825/21600","cluster_addr":"172.21.15.72:6827/21600","heartbeat_back_addr":"172.21.15.72:6831/21600","heartbeat_front_addr":"172.21.15.72:6829/21600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.259782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.267019+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.315501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.326256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.335328+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.284130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.083179+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.351445+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-12T14:12:43.604 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.601+0000 7f92b12f8700 1 -- 172.21.15.139:0/4207657126 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f929003a150 msgr2=0x7f929003c610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.604 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.601+0000 7f92b12f8700 1 --2- 172.21.15.139:0/4207657126 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f929003a150 0x7f929003c610 crc :-1 s=READY pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.604 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.601+0000 7f92b12f8700 1 -- 172.21.15.139:0/4207657126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac0a3f40 msgr2=0x7f92ac12b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.605 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.601+0000 7f92b12f8700 1 --2- 172.21.15.139:0/4207657126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac0a3f40 0x7f92ac12b780 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f92a4007ca0 tx=0x7f929c010800).stop 2020-02-12T14:12:43.605 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.602+0000 7f92b12f8700 1 -- 172.21.15.139:0/4207657126 shutdown_connections 2020-02-12T14:12:43.605 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.602+0000 7f92b12f8700 1 --2- 172.21.15.139:0/4207657126 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f929003a150 0x7f929003c610 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.605 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.602+0000 7f92b12f8700 1 --2- 172.21.15.139:0/4207657126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac0a3f40 0x7f92ac12b780 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.605 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.602+0000 7f92b12f8700 1 -- 172.21.15.139:0/4207657126 >> 172.21.15.139:0/4207657126 conn(0x7f92ac060950 msgr2=0x7f92ac05e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:43.605 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.602+0000 7f92b12f8700 1 -- 172.21.15.139:0/4207657126 shutdown_connections 2020-02-12T14:12:43.605 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.602+0000 7f92b12f8700 1 -- 172.21.15.139:0/4207657126 wait complete. 2020-02-12T14:12:43.615 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 flush_pg_stats 2020-02-12T14:12:43.721 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.719+0000 7fbca0b7c700 1 Processor -- start 2020-02-12T14:12:43.721 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.719+0000 7fbca0b7c700 1 -- start start 2020-02-12T14:12:43.728 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.719+0000 7fbca0b7c700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbc9c06a1e0 0x7fbc9c135de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:43.728 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.719+0000 7fbca0b7c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc9c0a1ba0 0x7fbc9c136240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:43.728 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.719+0000 7fbca0b7c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc9c09f240 con 0x7fbc9c132b30 2020-02-12T14:12:43.729 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.719+0000 7fbca0b7c700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc9c09f470 con 0x7fbc9c06a1e0 2020-02-12T14:12:43.729 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.719+0000 7fbca0b7c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c0a5cd0 con 0x7fbc9c0a1ba0 2020-02-12T14:12:43.729 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.719+0000 7fbc9b7fe700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbc9c06a1e0 0x7fbc9c135de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:43.729 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.719+0000 7fbc9b7fe700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbc9c06a1e0 0x7fbc9c135de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46764/0 (socket says 172.21.15.139:46764) 2020-02-12T14:12:43.729 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.719+0000 7fbc9b7fe700 1 -- 172.21.15.139:0/3780699827 learned_addr learned my addr 172.21.15.139:0/3780699827 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:43.729 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.719+0000 7fbc9affd700 1 --2- 172.21.15.139:0/3780699827 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc9c0a1ba0 0x7fbc9c136240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:43.729 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.720+0000 7fbc9b7fe700 1 -- 172.21.15.139:0/3780699827 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc9c0a1ba0 msgr2=0x7fbc9c136240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:43.730 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.720+0000 7fbc9b7fe700 1 --2- 172.21.15.139:0/3780699827 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc9c0a1ba0 0x7fbc9c136240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:43.730 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.720+0000 7fbc9b7fe700 1 -- 172.21.15.139:0/3780699827 >> v1:172.21.15.72:6789/0 conn(0x7fbc9c132b30 legacy=0x7fbc9c132fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.730 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.720+0000 7fbc9b7fe700 1 -- 172.21.15.139:0/3780699827 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9c1366a0 con 0x7fbc9c06a1e0 2020-02-12T14:12:43.730 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.720+0000 7fbc9b7fe700 1 --2- 172.21.15.139:0/3780699827 >> v2:172.21.15.139:3300/0 conn(0x7fbc9c06a1e0 0x7fbc9c135de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbc8c002f30 tx=0x7fbc8c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.730 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.720+0000 7fbc9b7fe700 1 --2- 172.21.15.139:0/3780699827 >> v2:172.21.15.139:3300/0 conn(0x7fbc9c06a1e0 0x7fbc9c135de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbc8c002f30 tx=0x7fbc8c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.730 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.720+0000 7fbc9b7fe700 1 --2- 172.21.15.139:0/3780699827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc9c06a1e0 0x7fbc9c135de0 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7fbc8c002f30 tx=0x7fbc8c0088e0).ready entity=mon.1 client_cookie=138bb6d4a4f1eca0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:43.730 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.720+0000 7fbc9b7fe700 1 --2- 172.21.15.139:0/3780699827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc9c06a1e0 0x7fbc9c135de0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7fbc8c002f30 tx=0x7fbc8c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.731 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.720+0000 7fbc9a7fc700 1 -- 172.21.15.139:0/3780699827 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc8c011760 con 0x7fbc9c06a1e0 2020-02-12T14:12:43.731 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.720+0000 7fbc9b7fe700 1 --2- 172.21.15.139:0/3780699827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc9c06a1e0 0x7fbc9c135de0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7fbc8c002f30 tx=0x7fbc8c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.731 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.720+0000 7fbc9a7fc700 1 -- 172.21.15.139:0/3780699827 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8c0118c0 con 0x7fbc9c06a1e0 2020-02-12T14:12:43.731 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.720+0000 7fbc9b7fe700 1 --2- 172.21.15.139:0/3780699827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc9c06a1e0 0x7fbc9c135de0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7fbc8c002f30 tx=0x7fbc8c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.731 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.720+0000 7fbc9a7fc700 1 -- 172.21.15.139:0/3780699827 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc8c011ca0 con 0x7fbc9c06a1e0 2020-02-12T14:12:43.731 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.720+0000 7fbca0b7c700 1 -- 172.21.15.139:0/3780699827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc9c06a1e0 msgr2=0x7fbc9c135de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.731 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.720+0000 7fbca0b7c700 1 --2- 172.21.15.139:0/3780699827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc9c06a1e0 0x7fbc9c135de0 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7fbc8c002f30 tx=0x7fbc8c0088e0).stop 2020-02-12T14:12:43.731 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.720+0000 7fbca0b7c700 1 -- 172.21.15.139:0/3780699827 shutdown_connections 2020-02-12T14:12:43.732 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.720+0000 7fbca0b7c700 1 --2- 172.21.15.139:0/3780699827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc9c06a1e0 0x7fbc9c135de0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.732 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.720+0000 7fbca0b7c700 1 --2- 172.21.15.139:0/3780699827 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc9c0a1ba0 0x7fbc9c136240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:43.732 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.720+0000 7fbca0b7c700 1 -- 172.21.15.139:0/3780699827 >> 172.21.15.139:0/3780699827 conn(0x7fbc9c061540 msgr2=0x7fbc9c069750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:43.732 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.720+0000 7fbca0b7c700 1 -- 172.21.15.139:0/3780699827 shutdown_connections 2020-02-12T14:12:43.732 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.720+0000 7fbca0b7c700 1 -- 172.21.15.139:0/3780699827 wait complete. 2020-02-12T14:12:43.732 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.721+0000 7fbca0b7c700 1 Processor -- start 2020-02-12T14:12:43.732 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.722+0000 7fbca0b7c700 1 -- start start 2020-02-12T14:12:43.733 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.722+0000 7fbca0b7c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc9c06a1e0 0x7fbc9c1378d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:43.733 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.722+0000 7fbca0b7c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbc9c132b30 0x7fbc9c149500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:43.733 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.722+0000 7fbca0b7c700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc9c0a04c0 con 0x7fbc9c0a1ba0 2020-02-12T14:12:43.733 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.722+0000 7fbca0b7c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc9c13fc90 con 0x7fbc9c132b30 2020-02-12T14:12:43.733 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.722+0000 7fbca0b7c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c148b20 con 0x7fbc9c06a1e0 2020-02-12T14:12:43.733 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.722+0000 7fbc9affd700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fbc9c0a1ba0 0x7fbc9c0a2ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35410/0 (socket says 172.21.15.139:35410) 2020-02-12T14:12:43.733 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.722+0000 7fbc9affd700 1 -- 172.21.15.139:0/1842967913 learned_addr learned my addr 172.21.15.139:0/1842967913 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:43.734 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.722+0000 7fbc9bfff700 1 --2- 172.21.15.139:0/1842967913 >> v2:172.21.15.72:3300/0 conn(0x7fbc9c132b30 0x7fbc9c149500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:43.734 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.722+0000 7fbc9b7fe700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc9c06a1e0 0x7fbc9c1378d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:43.734 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.722+0000 7fbc98ff9700 1 -- 172.21.15.139:0/1842967913 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958652463 0 0) 0x7fbc9c0a04c0 con 0x7fbc9c0a1ba0 2020-02-12T14:12:43.734 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.722+0000 7fbc98ff9700 1 -- 172.21.15.139:0/1842967913 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc7c002fe0 con 0x7fbc9c0a1ba0 2020-02-12T14:12:43.734 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc98ff9700 1 -- 172.21.15.139:0/1842967913 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2097213657 0 0) 0x7fbc7c002fe0 con 0x7fbc9c0a1ba0 2020-02-12T14:12:43.734 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc98ff9700 1 -- 172.21.15.139:0/1842967913 --> v1:172.21.15.139:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbc9c0a04c0 con 0x7fbc9c0a1ba0 2020-02-12T14:12:43.734 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc98ff9700 1 -- 172.21.15.139:0/1842967913 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7fbc900025c0 con 0x7fbc9c0a1ba0 2020-02-12T14:12:43.735 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc98ff9700 1 -- 172.21.15.139:0/1842967913 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc9c06a1e0 msgr2=0x7fbc9c1378d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.735 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc98ff9700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc9c06a1e0 0x7fbc9c1378d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.735 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc98ff9700 1 -- 172.21.15.139:0/1842967913 >> v2:172.21.15.72:3300/0 conn(0x7fbc9c132b30 msgr2=0x7fbc9c149500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.735 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc98ff9700 1 --2- 172.21.15.139:0/1842967913 >> v2:172.21.15.72:3300/0 conn(0x7fbc9c132b30 0x7fbc9c149500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.735 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc98ff9700 1 -- 172.21.15.139:0/1842967913 >> v1:172.21.15.139:6789/0 conn(0x7fbc9c0a1ba0 legacy=0x7fbc9c0a2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.735 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc98ff9700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc7c0049b0 0x7fbc7c004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:43.735 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc98ff9700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc7c003920 0x7fbc7c003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:43.736 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc98ff9700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc9c06a1e0 0x7fbc7c0041c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:43.736 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc98ff9700 1 -- 172.21.15.139:0/1842967913 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c13fc90 con 0x7fbc7c003920 2020-02-12T14:12:43.736 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc98ff9700 1 -- 172.21.15.139:0/1842967913 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c148b20 con 0x7fbc7c0049b0 2020-02-12T14:12:43.736 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc98ff9700 1 -- 172.21.15.139:0/1842967913 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c005550 con 0x7fbc9c06a1e0 2020-02-12T14:12:43.736 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc9b7fe700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc7c0049b0 0x7fbc7c004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:43.736 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc9bfff700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc9c06a1e0 0x7fbc7c0041c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:43.736 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc9affd700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc7c003920 0x7fbc7c003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:43.736 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc9b7fe700 1 -- 172.21.15.139:0/1842967913 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc9c06a1e0 msgr2=0x7fbc7c0041c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.737 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc9b7fe700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc9c06a1e0 0x7fbc7c0041c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.737 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc9b7fe700 1 -- 172.21.15.139:0/1842967913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc7c003920 msgr2=0x7fbc7c003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.737 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc9b7fe700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc7c003920 0x7fbc7c003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.737 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc9b7fe700 1 -- 172.21.15.139:0/1842967913 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9c148dc0 con 0x7fbc7c0049b0 2020-02-12T14:12:43.737 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbca0b7c700 1 -- 172.21.15.139:0/1842967913 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc9c149060 con 0x7fbc7c0049b0 2020-02-12T14:12:43.737 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc9b7fe700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc7c0049b0 0x7fbc7c004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbc8c002f30 tx=0x7fbc9c0a5e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.737 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbca0b7c700 1 -- 172.21.15.139:0/1842967913 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc9c0a9190 con 0x7fbc7c0049b0 2020-02-12T14:12:43.738 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc9b7fe700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc7c0049b0 0x7fbc7c004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbc8c002f30 tx=0x7fbc9c0a5e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.738 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc9b7fe700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc7c0049b0 0x7fbc7c004dd0 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7fbc8c002f30 tx=0x7fbc9c0a5e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:43.738 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc9b7fe700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc7c0049b0 0x7fbc7c004dd0 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7fbc8c002f30 tx=0x7fbc9c0a5e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.738 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc98ff9700 1 -- 172.21.15.139:0/1842967913 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc8c011d30 con 0x7fbc7c0049b0 2020-02-12T14:12:43.738 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc9b7fe700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc7c0049b0 0x7fbc7c004dd0 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7fbc8c002f30 tx=0x7fbc9c0a5e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.738 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc9b7fe700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc7c0049b0 0x7fbc7c004dd0 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7fbc8c002f30 tx=0x7fbc9c0a5e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.738 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc98ff9700 1 -- 172.21.15.139:0/1842967913 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8c007150 con 0x7fbc7c0049b0 2020-02-12T14:12:43.739 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.723+0000 7fbc98ff9700 1 -- 172.21.15.139:0/1842967913 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc8c0074b0 con 0x7fbc7c0049b0 2020-02-12T14:12:43.739 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.724+0000 7fbc9b7fe700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc7c0049b0 0x7fbc7c004dd0 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7fbc8c002f30 tx=0x7fbc9c0a5e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.739 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.724+0000 7fbca0b7c700 1 -- 172.21.15.139:0/1842967913 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbc78003580 con 0x7fbc7c0049b0 2020-02-12T14:12:43.739 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.724+0000 7fbc98ff9700 1 -- 172.21.15.139:0/1842967913 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fbc8c0056c0 con 0x7fbc7c0049b0 2020-02-12T14:12:43.739 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.724+0000 7fbc9b7fe700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc7c0049b0 0x7fbc7c004dd0 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7fbc8c002f30 tx=0x7fbc9c0a5e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.739 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.724+0000 7fbc9b7fe700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc7c0049b0 0x7fbc7c004dd0 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7fbc8c002f30 tx=0x7fbc9c0a5e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.740 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.724+0000 7fbc98ff9700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fbc7c041f00 0x7fbc7c0443c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:43.740 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.724+0000 7fbc98ff9700 1 -- 172.21.15.139:0/1842967913 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fbc8c04a0f0 con 0x7fbc7c0049b0 2020-02-12T14:12:43.740 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.724+0000 7fbc9affd700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fbc7c041f00 0x7fbc7c0443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:43.740 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.724+0000 7fbc98ff9700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.139:6802/22147,v1:172.21.15.139:6803/22147] conn(0x7fbc7c048a80 0x7fbc7c04aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:43.740 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.724+0000 7fbc98ff9700 1 -- 172.21.15.139:0/1842967913 --> [v2:172.21.15.139:6802/22147,v1:172.21.15.139:6803/22147] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc7c04b4f0 con 0x7fbc7c048a80 2020-02-12T14:12:43.740 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.724+0000 7fbc98ff9700 1 -- 172.21.15.139:0/1842967913 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc8c04b530 con 0x7fbc7c0049b0 2020-02-12T14:12:43.740 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.725+0000 7fbc9bfff700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.139:6802/22147,v1:172.21.15.139:6803/22147] conn(0x7fbc7c048a80 0x7fbc7c04aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:43.740 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.725+0000 7fbc9affd700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fbc7c041f00 0x7fbc7c0443c0 crc :-1 s=READY pgs=59 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:43.741 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.725+0000 7fbc9bfff700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.139:6802/22147,v1:172.21.15.139:6803/22147] conn(0x7fbc7c048a80 0x7fbc7c04aea0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:43.741 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.725+0000 7fbc98ff9700 1 -- 172.21.15.139:0/1842967913 <== osd.0 v2:172.21.15.139:6802/22147 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7fbc7c04b4f0 con 0x7fbc7c048a80 2020-02-12T14:12:43.745 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.743+0000 7fbca0b7c700 1 -- 172.21.15.139:0/1842967913 --> [v2:172.21.15.139:6802/22147,v1:172.21.15.139:6803/22147] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbc78002680 con 0x7fbc7c048a80 2020-02-12T14:12:43.745 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.743+0000 7fbc98ff9700 1 -- 172.21.15.139:0/1842967913 <== osd.0 v2:172.21.15.139:6802/22147 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbc78002680 con 0x7fbc7c048a80 2020-02-12T14:12:43.746 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.743+0000 7fbca0b7c700 1 -- 172.21.15.139:0/1842967913 >> [v2:172.21.15.139:6802/22147,v1:172.21.15.139:6803/22147] conn(0x7fbc7c048a80 msgr2=0x7fbc7c04aea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.746 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.743+0000 7fbca0b7c700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.139:6802/22147,v1:172.21.15.139:6803/22147] conn(0x7fbc7c048a80 0x7fbc7c04aea0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.746 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.743+0000 7fbc9bfff700 1 -- 172.21.15.139:0/1842967913 reap_dead start 2020-02-12T14:12:43.747 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.743+0000 7fbca0b7c700 1 -- 172.21.15.139:0/1842967913 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fbc7c041f00 msgr2=0x7fbc7c0443c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.747 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.743+0000 7fbca0b7c700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fbc7c041f00 0x7fbc7c0443c0 crc :-1 s=READY pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.747 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.743+0000 7fbca0b7c700 1 -- 172.21.15.139:0/1842967913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc7c0049b0 msgr2=0x7fbc7c004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.747 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.743+0000 7fbca0b7c700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc7c0049b0 0x7fbc7c004dd0 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7fbc8c002f30 tx=0x7fbc9c0a5e40).stop 2020-02-12T14:12:43.747 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.743+0000 7fbca0b7c700 1 -- 172.21.15.139:0/1842967913 shutdown_connections 2020-02-12T14:12:43.747 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.743+0000 7fbca0b7c700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc7c0049b0 0x7fbc7c004dd0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.747 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.743+0000 7fbca0b7c700 1 --2- 172.21.15.139:0/1842967913 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fbc7c041f00 0x7fbc7c0443c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.748 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.743+0000 7fbca0b7c700 1 -- 172.21.15.139:0/1842967913 >> 172.21.15.139:0/1842967913 conn(0x7fbc9c061540 msgr2=0x7fbc9c1323c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:43.748 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.743+0000 7fbca0b7c700 1 -- 172.21.15.139:0/1842967913 shutdown_connections 2020-02-12T14:12:43.748 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.743+0000 7fbca0b7c700 1 -- 172.21.15.139:0/1842967913 wait complete. 2020-02-12T14:12:43.755 INFO:teuthology.orchestra.run.smithi139.stdout:55834574855 2020-02-12T14:12:43.756 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 flush_pg_stats 2020-02-12T14:12:43.862 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.859+0000 7fafbc884700 1 Processor -- start 2020-02-12T14:12:43.862 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.859+0000 7fafbc884700 1 -- start start 2020-02-12T14:12:43.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.860+0000 7fafbc884700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fafb80a7080 0x7fafb80a3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:43.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.860+0000 7fafbc884700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fafb80a36e0 0x7fafb809f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:43.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.860+0000 7fafbc884700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fafb809f680 0x7fafb809faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:43.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.860+0000 7fafbc884700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb809e3b0 con 0x7fafb80a7080 2020-02-12T14:12:43.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.860+0000 7fafbc884700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb809e7e0 con 0x7fafb80a36e0 2020-02-12T14:12:43.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.860+0000 7fafbc884700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb809ea80 con 0x7fafb809f680 2020-02-12T14:12:43.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.860+0000 7fafb659c700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fafb80a36e0 0x7fafb809f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:43.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.860+0000 7fafb659c700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fafb80a36e0 0x7fafb809f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46786/0 (socket says 172.21.15.139:46786) 2020-02-12T14:12:43.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.860+0000 7fafb659c700 1 -- 172.21.15.139:0/2803409692 learned_addr learned my addr 172.21.15.139:0/2803409692 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:43.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.860+0000 7fafb6d9d700 1 --2- 172.21.15.139:0/2803409692 >> v2:172.21.15.72:3300/0 conn(0x7fafb80a7080 0x7fafb80a3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:43.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.860+0000 7fafb759e700 1 --2- 172.21.15.139:0/2803409692 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fafb809f680 0x7fafb809faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:43.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.861+0000 7fafb659c700 1 -- 172.21.15.139:0/2803409692 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fafb809f680 msgr2=0x7fafb809faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:43.870 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.861+0000 7fafb659c700 1 --2- 172.21.15.139:0/2803409692 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fafb809f680 0x7fafb809faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:43.870 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.861+0000 7fafb659c700 1 -- 172.21.15.139:0/2803409692 >> v2:172.21.15.72:3300/0 conn(0x7fafb80a7080 msgr2=0x7fafb80a3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:43.870 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.861+0000 7fafb659c700 1 --2- 172.21.15.139:0/2803409692 >> v2:172.21.15.72:3300/0 conn(0x7fafb80a7080 0x7fafb80a3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:43.870 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.861+0000 7fafb659c700 1 -- 172.21.15.139:0/2803409692 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb809ed20 con 0x7fafb80a36e0 2020-02-12T14:12:43.870 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.861+0000 7fafb659c700 1 --2- 172.21.15.139:0/2803409692 >> v2:172.21.15.139:3300/0 conn(0x7fafb80a36e0 0x7fafb809f220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fafa8002f30 tx=0x7fafa8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.871 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.861+0000 7fafb659c700 1 --2- 172.21.15.139:0/2803409692 >> v2:172.21.15.139:3300/0 conn(0x7fafb80a36e0 0x7fafb809f220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fafa8002f30 tx=0x7fafa8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.871 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.861+0000 7fafb659c700 1 --2- 172.21.15.139:0/2803409692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb80a36e0 0x7fafb809f220 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7fafa8002f30 tx=0x7fafa8007a40).ready entity=mon.1 client_cookie=b5677dc6e549f7ca server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:43.871 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.861+0000 7fafb659c700 1 --2- 172.21.15.139:0/2803409692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb80a36e0 0x7fafb809f220 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7fafa8002f30 tx=0x7fafa8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.871 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.861+0000 7fafb659c700 1 --2- 172.21.15.139:0/2803409692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb80a36e0 0x7fafb809f220 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7fafa8002f30 tx=0x7fafa8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.871 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.861+0000 7fafb5d9b700 1 -- 172.21.15.139:0/2803409692 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafa80115c0 con 0x7fafb80a36e0 2020-02-12T14:12:43.871 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.861+0000 7fafb659c700 1 --2- 172.21.15.139:0/2803409692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb80a36e0 0x7fafb809f220 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7fafa8002f30 tx=0x7fafa8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.871 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.861+0000 7fafb5d9b700 1 -- 172.21.15.139:0/2803409692 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa8011720 con 0x7fafb80a36e0 2020-02-12T14:12:43.871 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.861+0000 7fafb5d9b700 1 -- 172.21.15.139:0/2803409692 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafa8011b00 con 0x7fafb80a36e0 2020-02-12T14:12:43.872 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.861+0000 7fafbc884700 1 -- 172.21.15.139:0/2803409692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb80a36e0 msgr2=0x7fafb809f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.872 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.861+0000 7fafbc884700 1 --2- 172.21.15.139:0/2803409692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb80a36e0 0x7fafb809f220 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7fafa8002f30 tx=0x7fafa8007a40).stop 2020-02-12T14:12:43.872 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.861+0000 7fafbc884700 1 -- 172.21.15.139:0/2803409692 shutdown_connections 2020-02-12T14:12:43.872 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.861+0000 7fafbc884700 1 --2- 172.21.15.139:0/2803409692 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fafb809f680 0x7fafb809faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:43.872 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.861+0000 7fafbc884700 1 --2- 172.21.15.139:0/2803409692 >> v2:172.21.15.72:3300/0 conn(0x7fafb80a7080 0x7fafb80a3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:43.872 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.861+0000 7fafbc884700 1 --2- 172.21.15.139:0/2803409692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb80a36e0 0x7fafb809f220 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.872 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.861+0000 7fafbc884700 1 -- 172.21.15.139:0/2803409692 >> 172.21.15.139:0/2803409692 conn(0x7fafb805a720 msgr2=0x7fafb805ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:43.873 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.861+0000 7fafbc884700 1 -- 172.21.15.139:0/2803409692 shutdown_connections 2020-02-12T14:12:43.873 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.861+0000 7fafbc884700 1 -- 172.21.15.139:0/2803409692 wait complete. 2020-02-12T14:12:43.873 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.862+0000 7fafbc884700 1 Processor -- start 2020-02-12T14:12:43.873 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.862+0000 7fafbc884700 1 -- start start 2020-02-12T14:12:43.873 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.863+0000 7fafbc884700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fafb809f680 0x7fafb80a9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:43.873 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.863+0000 7fafbc884700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fafb80a7080 0x7fafb808efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:43.873 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.863+0000 7fafbc884700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb8090ad0 con 0x7fafb80a36e0 2020-02-12T14:12:43.873 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.863+0000 7fafbc884700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb81456e0 con 0x7fafb809f680 2020-02-12T14:12:43.874 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.863+0000 7fafbc884700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb8090d70 con 0x7fafb80a7080 2020-02-12T14:12:43.874 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.863+0000 7fafb759e700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fafb80a7080 0x7fafb808efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:43.874 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.863+0000 7fafb759e700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fafb80a7080 0x7fafb808efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46792/0 (socket says 172.21.15.139:46792) 2020-02-12T14:12:43.874 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.863+0000 7fafb759e700 1 -- 172.21.15.139:0/736669535 learned_addr learned my addr 172.21.15.139:0/736669535 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:43.874 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.863+0000 7fafb6d9d700 1 --2- 172.21.15.139:0/736669535 >> v2:172.21.15.72:3300/0 conn(0x7fafb809f680 0x7fafb80a9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:43.874 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.863+0000 7fafb759e700 1 -- 172.21.15.139:0/736669535 >> v2:172.21.15.72:3300/0 conn(0x7fafb809f680 msgr2=0x7fafb80a9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.874 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.863+0000 7fafb759e700 1 --2- 172.21.15.139:0/736669535 >> v2:172.21.15.72:3300/0 conn(0x7fafb809f680 0x7fafb80a9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.875 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.863+0000 7fafb759e700 1 -- 172.21.15.139:0/736669535 >> v1:172.21.15.72:6789/0 conn(0x7fafb80a36e0 legacy=0x7fafb8066440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.875 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.863+0000 7fafb759e700 1 -- 172.21.15.139:0/736669535 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb8065fa0 con 0x7fafb80a7080 2020-02-12T14:12:43.875 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.863+0000 7fafb759e700 1 --2- 172.21.15.139:0/736669535 >> v2:172.21.15.139:3300/0 conn(0x7fafb80a7080 0x7fafb808efd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fafb00032b0 tx=0x7fafb0010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.875 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.863+0000 7fafb759e700 1 --2- 172.21.15.139:0/736669535 >> v2:172.21.15.139:3300/0 conn(0x7fafb80a7080 0x7fafb808efd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fafb00032b0 tx=0x7fafb0010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.875 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.863+0000 7fafb759e700 1 --2- 172.21.15.139:0/736669535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb80a7080 0x7fafb808efd0 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7fafb00032b0 tx=0x7fafb0010f30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:43.875 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.863+0000 7fafb759e700 1 --2- 172.21.15.139:0/736669535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb80a7080 0x7fafb808efd0 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7fafb00032b0 tx=0x7fafb0010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.875 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.863+0000 7fafb759e700 1 --2- 172.21.15.139:0/736669535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb80a7080 0x7fafb808efd0 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7fafb00032b0 tx=0x7fafb0010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.876 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.863+0000 7fafaffff700 1 -- 172.21.15.139:0/736669535 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafb000e350 con 0x7fafb80a7080 2020-02-12T14:12:43.876 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.864+0000 7fafb759e700 1 --2- 172.21.15.139:0/736669535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb80a7080 0x7fafb808efd0 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7fafb00032b0 tx=0x7fafb0010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.876 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.864+0000 7fafaffff700 1 -- 172.21.15.139:0/736669535 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb0005c30 con 0x7fafb80a7080 2020-02-12T14:12:43.876 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.864+0000 7fafbc884700 1 -- 172.21.15.139:0/736669535 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb80670c0 con 0x7fafb80a7080 2020-02-12T14:12:43.876 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.864+0000 7fafaffff700 1 -- 172.21.15.139:0/736669535 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafb0005e20 con 0x7fafb80a7080 2020-02-12T14:12:43.876 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.864+0000 7fafbc884700 1 -- 172.21.15.139:0/736669535 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb8090630 con 0x7fafb80a7080 2020-02-12T14:12:43.876 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.864+0000 7fafb759e700 1 --2- 172.21.15.139:0/736669535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb80a7080 0x7fafb808efd0 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7fafb00032b0 tx=0x7fafb0010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.876 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.864+0000 7fafbc884700 1 -- 172.21.15.139:0/736669535 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fafb8090910 con 0x7fafb80a7080 2020-02-12T14:12:43.877 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.864+0000 7fafaffff700 1 -- 172.21.15.139:0/736669535 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fafb0012c00 con 0x7fafb80a7080 2020-02-12T14:12:43.877 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.864+0000 7fafb759e700 1 --2- 172.21.15.139:0/736669535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb80a7080 0x7fafb808efd0 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7fafb00032b0 tx=0x7fafb0010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.877 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.865+0000 7fafb759e700 1 --2- 172.21.15.139:0/736669535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb80a7080 0x7fafb808efd0 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7fafb00032b0 tx=0x7fafb0010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:43.877 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.865+0000 7fafaffff700 1 --2- 172.21.15.139:0/736669535 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7faf9c039bf0 0x7faf9c03c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:43.877 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.865+0000 7fafaffff700 1 -- 172.21.15.139:0/736669535 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fafb0049a10 con 0x7fafb80a7080 2020-02-12T14:12:43.877 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.865+0000 7fafb6d9d700 1 --2- 172.21.15.139:0/736669535 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7faf9c039bf0 0x7faf9c03c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:43.877 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.865+0000 7fafaffff700 1 --2- 172.21.15.139:0/736669535 >> [v2:172.21.15.139:6810/22148,v1:172.21.15.139:6811/22148] conn(0x7faf9c040840 0x7faf9c042c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:43.878 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.865+0000 7fafaffff700 1 -- 172.21.15.139:0/736669535 --> [v2:172.21.15.139:6810/22148,v1:172.21.15.139:6811/22148] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faf9c043220 con 0x7faf9c040840 2020-02-12T14:12:43.878 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.865+0000 7fafaffff700 1 -- 172.21.15.139:0/736669535 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fafb004ae70 con 0x7fafb80a7080 2020-02-12T14:12:43.878 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.865+0000 7fafb659c700 1 --2- 172.21.15.139:0/736669535 >> [v2:172.21.15.139:6810/22148,v1:172.21.15.139:6811/22148] conn(0x7faf9c040840 0x7faf9c042c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:43.878 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.865+0000 7fafb6d9d700 1 --2- 172.21.15.139:0/736669535 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7faf9c039bf0 0x7faf9c03c0b0 crc :-1 s=READY pgs=60 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:43.878 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.865+0000 7fafb659c700 1 --2- 172.21.15.139:0/736669535 >> [v2:172.21.15.139:6810/22148,v1:172.21.15.139:6811/22148] conn(0x7faf9c040840 0x7faf9c042c60 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:43.878 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.866+0000 7fafaffff700 1 -- 172.21.15.139:0/736669535 <== osd.1 v2:172.21.15.139:6810/22148 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7faf9c043220 con 0x7faf9c040840 2020-02-12T14:12:43.885 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.883+0000 7fafbc884700 1 -- 172.21.15.139:0/736669535 --> [v2:172.21.15.139:6810/22148,v1:172.21.15.139:6811/22148] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fafb8146290 con 0x7faf9c040840 2020-02-12T14:12:43.885 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.883+0000 7fafaffff700 1 -- 172.21.15.139:0/736669535 <== osd.1 v2:172.21.15.139:6810/22148 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fafb8146290 con 0x7faf9c040840 2020-02-12T14:12:43.886 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.883+0000 7fafbc884700 1 -- 172.21.15.139:0/736669535 >> [v2:172.21.15.139:6810/22148,v1:172.21.15.139:6811/22148] conn(0x7faf9c040840 msgr2=0x7faf9c042c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.887 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.883+0000 7fafbc884700 1 --2- 172.21.15.139:0/736669535 >> [v2:172.21.15.139:6810/22148,v1:172.21.15.139:6811/22148] conn(0x7faf9c040840 0x7faf9c042c60 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.887 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.884+0000 7fafbc884700 1 -- 172.21.15.139:0/736669535 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7faf9c039bf0 msgr2=0x7faf9c03c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.887 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.884+0000 7fafbc884700 1 --2- 172.21.15.139:0/736669535 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7faf9c039bf0 0x7faf9c03c0b0 crc :-1 s=READY pgs=60 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.887 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.884+0000 7fafbc884700 1 -- 172.21.15.139:0/736669535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb80a7080 msgr2=0x7fafb808efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:43.887 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.884+0000 7fafbc884700 1 --2- 172.21.15.139:0/736669535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb80a7080 0x7fafb808efd0 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7fafb00032b0 tx=0x7fafb0010f30).stop 2020-02-12T14:12:43.887 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.884+0000 7fafb759e700 1 -- 172.21.15.139:0/736669535 reap_dead start 2020-02-12T14:12:43.888 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.884+0000 7fafbc884700 1 -- 172.21.15.139:0/736669535 shutdown_connections 2020-02-12T14:12:43.888 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.884+0000 7fafbc884700 1 --2- 172.21.15.139:0/736669535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb80a7080 0x7fafb808efd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:43.888 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.884+0000 7fafbc884700 1 -- 172.21.15.139:0/736669535 >> 172.21.15.139:0/736669535 conn(0x7fafb805a720 msgr2=0x7fafb805e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:43.888 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.884+0000 7fafbc884700 1 -- 172.21.15.139:0/736669535 shutdown_connections 2020-02-12T14:12:43.888 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:43.884+0000 7fafbc884700 1 -- 172.21.15.139:0/736669535 wait complete. 2020-02-12T14:12:43.895 INFO:teuthology.orchestra.run.smithi139.stdout:55834574854 2020-02-12T14:12:43.896 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 flush_pg_stats 2020-02-12T14:12:44.002 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.000+0000 7f3a1f13b700 1 Processor -- start 2020-02-12T14:12:44.002 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.000+0000 7f3a1f13b700 1 -- start start 2020-02-12T14:12:44.005 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.001+0000 7f3a1f13b700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3a1805ab20 0x7f3a1805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:44.005 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.001+0000 7f3a1f13b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a180a4d80 con 0x7f3a1812fac0 2020-02-12T14:12:44.005 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.001+0000 7f3a1f13b700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a180a4530 con 0x7f3a180a3de0 2020-02-12T14:12:44.005 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.001+0000 7f3a1f13b700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a180a4fe0 con 0x7f3a1805ab20 2020-02-12T14:12:44.006 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.001+0000 7f3a17fff700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3a1805ab20 0x7f3a1805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.006 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.001+0000 7f3a1ced7700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f3a180a3de0 0x7f3a1809e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35438/0 (socket says 172.21.15.139:35438) 2020-02-12T14:12:44.006 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.001+0000 7f3a1ced7700 1 -- 172.21.15.139:0/973912142 learned_addr learned my addr 172.21.15.139:0/973912142 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:44.006 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.001+0000 7f3a17fff700 1 -- 172.21.15.139:0/973912142 >> v1:172.21.15.139:6789/0 conn(0x7f3a180a3de0 legacy=0x7f3a1809e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.006 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.001+0000 7f3a17fff700 1 -- 172.21.15.139:0/973912142 >> v1:172.21.15.72:6789/0 conn(0x7f3a1812fac0 legacy=0x7f3a1812ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.006 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.001+0000 7f3a177fe700 1 -- 172.21.15.139:0/973912142 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2954379399 0 0) 0x7f3a180a4530 con 0x7f3a180a3de0 2020-02-12T14:12:44.006 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.001+0000 7f3a17fff700 1 -- 172.21.15.139:0/973912142 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a180a5280 con 0x7f3a1805ab20 2020-02-12T14:12:44.007 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.001+0000 7f3a17fff700 1 --2- 172.21.15.139:0/973912142 >> v2:172.21.15.139:3300/0 conn(0x7f3a1805ab20 0x7f3a1805afd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3a080010d0 tx=0x7f3a0c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.007 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.001+0000 7f3a17fff700 1 --2- 172.21.15.139:0/973912142 >> v2:172.21.15.139:3300/0 conn(0x7f3a1805ab20 0x7f3a1805afd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3a080010d0 tx=0x7f3a0c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.007 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.001+0000 7f3a17fff700 1 --2- 172.21.15.139:0/973912142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a1805ab20 0x7f3a1805afd0 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f3a080010d0 tx=0x7f3a0c0088e0).ready entity=mon.1 client_cookie=d9c55c84f1683d50 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.007 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.001+0000 7f3a17fff700 1 --2- 172.21.15.139:0/973912142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a1805ab20 0x7f3a1805afd0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f3a080010d0 tx=0x7f3a0c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.007 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.001+0000 7f3a177fe700 1 -- 172.21.15.139:0/973912142 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a0c008d30 con 0x7f3a1805ab20 2020-02-12T14:12:44.007 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.001+0000 7f3a17fff700 1 --2- 172.21.15.139:0/973912142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a1805ab20 0x7f3a1805afd0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f3a080010d0 tx=0x7f3a0c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.007 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.001+0000 7f3a17fff700 1 --2- 172.21.15.139:0/973912142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a1805ab20 0x7f3a1805afd0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f3a080010d0 tx=0x7f3a0c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.008 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.001+0000 7f3a177fe700 1 -- 172.21.15.139:0/973912142 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0c008e90 con 0x7f3a1805ab20 2020-02-12T14:12:44.008 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.001+0000 7f3a177fe700 1 -- 172.21.15.139:0/973912142 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a0c0118e0 con 0x7f3a1805ab20 2020-02-12T14:12:44.008 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.001+0000 7f3a1f13b700 1 -- 172.21.15.139:0/973912142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a1805ab20 msgr2=0x7f3a1805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.008 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.001+0000 7f3a1f13b700 1 --2- 172.21.15.139:0/973912142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a1805ab20 0x7f3a1805afd0 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f3a080010d0 tx=0x7f3a0c0088e0).stop 2020-02-12T14:12:44.008 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.002+0000 7f3a1f13b700 1 -- 172.21.15.139:0/973912142 shutdown_connections 2020-02-12T14:12:44.008 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.002+0000 7f3a1f13b700 1 --2- 172.21.15.139:0/973912142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a1805ab20 0x7f3a1805afd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.008 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.002+0000 7f3a1f13b700 1 -- 172.21.15.139:0/973912142 >> 172.21.15.139:0/973912142 conn(0x7f3a18060950 msgr2=0x7f3a1809d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:44.008 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.002+0000 7f3a1f13b700 1 -- 172.21.15.139:0/973912142 shutdown_connections 2020-02-12T14:12:44.009 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.002+0000 7f3a1f13b700 1 -- 172.21.15.139:0/973912142 wait complete. 2020-02-12T14:12:44.009 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.003+0000 7f3a1f13b700 1 Processor -- start 2020-02-12T14:12:44.009 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.003+0000 7f3a1f13b700 1 -- start start 2020-02-12T14:12:44.013 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.003+0000 7f3a1f13b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3a1805ab20 0x7f3a18135700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.013 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.003+0000 7f3a1f13b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a1812e340 con 0x7f3a1812fac0 2020-02-12T14:12:44.014 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.003+0000 7f3a1f13b700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a18133d60 con 0x7f3a180a3de0 2020-02-12T14:12:44.014 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.003+0000 7f3a1f13b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a18134630 con 0x7f3a1805ab20 2020-02-12T14:12:44.014 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a17fff700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f3a180a3de0 0x7f3a18127670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35446/0 (socket says 172.21.15.139:35446) 2020-02-12T14:12:44.014 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a17fff700 1 -- 172.21.15.139:0/718020413 learned_addr learned my addr 172.21.15.139:0/718020413 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:44.014 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a1ced7700 1 --2- 172.21.15.139:0/718020413 >> v2:172.21.15.72:3300/0 conn(0x7f3a1805ab20 0x7f3a18135700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.014 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a15ffb700 1 -- 172.21.15.139:0/718020413 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3935482813 0 0) 0x7f3a18133d60 con 0x7f3a180a3de0 2020-02-12T14:12:44.014 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a15ffb700 1 -- 172.21.15.139:0/718020413 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39f8002fe0 con 0x7f3a180a3de0 2020-02-12T14:12:44.015 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a15ffb700 1 -- 172.21.15.139:0/718020413 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4068709237 0 0) 0x7f39f8002fe0 con 0x7f3a180a3de0 2020-02-12T14:12:44.015 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a15ffb700 1 -- 172.21.15.139:0/718020413 --> v1:172.21.15.139:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3a18133d60 con 0x7f3a180a3de0 2020-02-12T14:12:44.015 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a15ffb700 1 -- 172.21.15.139:0/718020413 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7f3a0c008660 con 0x7f3a180a3de0 2020-02-12T14:12:44.015 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a15ffb700 1 -- 172.21.15.139:0/718020413 >> v2:172.21.15.72:3300/0 conn(0x7f3a1805ab20 msgr2=0x7f3a18135700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.015 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a15ffb700 1 --2- 172.21.15.139:0/718020413 >> v2:172.21.15.72:3300/0 conn(0x7f3a1805ab20 0x7f3a18135700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.015 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a15ffb700 1 -- 172.21.15.139:0/718020413 >> v1:172.21.15.139:6789/0 conn(0x7f3a180a3de0 legacy=0x7f3a18127670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.015 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a15ffb700 1 -- 172.21.15.139:0/718020413 >> v1:172.21.15.72:6789/0 conn(0x7f3a1812fac0 legacy=0x7f3a1814dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.016 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a15ffb700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39f80049b0 0x7f39f8004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.016 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a15ffb700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39f8003920 0x7f39f8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.016 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a15ffb700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39f80041e0 0x7f39f800b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.016 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a15ffb700 1 -- 172.21.15.139:0/718020413 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a18134630 con 0x7f39f8003920 2020-02-12T14:12:44.016 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a15ffb700 1 -- 172.21.15.139:0/718020413 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f800bbb0 con 0x7f39f80041e0 2020-02-12T14:12:44.016 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a15ffb700 1 -- 172.21.15.139:0/718020413 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f800bcf0 con 0x7f39f80049b0 2020-02-12T14:12:44.016 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a1d6d8700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39f80041e0 0x7f39f800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.016 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a17fff700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39f8003920 0x7f39f8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.017 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a1ced7700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39f80049b0 0x7f39f8004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.017 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a1d6d8700 1 -- 172.21.15.139:0/718020413 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39f80049b0 msgr2=0x7f39f8004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.017 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a1d6d8700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39f80049b0 0x7f39f8004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.017 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a1d6d8700 1 -- 172.21.15.139:0/718020413 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39f8003920 msgr2=0x7f39f8003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.017 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a1d6d8700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39f8003920 0x7f39f8003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.017 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a1d6d8700 1 -- 172.21.15.139:0/718020413 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a18134000 con 0x7f39f80041e0 2020-02-12T14:12:44.017 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a1f13b700 1 -- 172.21.15.139:0/718020413 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1812d390 con 0x7f39f80041e0 2020-02-12T14:12:44.018 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a1d6d8700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39f80041e0 0x7f39f800b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f39f80048f0 tx=0x7f3a08002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.018 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a1d6d8700 1 -- 172.21.15.139:0/718020413 reap_dead start 2020-02-12T14:12:44.018 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.004+0000 7f3a1f13b700 1 -- 172.21.15.139:0/718020413 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1812ed10 con 0x7f39f80041e0 2020-02-12T14:12:44.018 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.005+0000 7f3a1d6d8700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39f80041e0 0x7f39f800b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f39f80048f0 tx=0x7f3a08002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.018 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.005+0000 7f3a1d6d8700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39f80041e0 0x7f39f800b750 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7f39f80048f0 tx=0x7f3a08002e70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.018 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.005+0000 7f3a1d6d8700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39f80041e0 0x7f39f800b750 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f39f80048f0 tx=0x7f3a08002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.018 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.005+0000 7f3a15ffb700 1 -- 172.21.15.139:0/718020413 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a0800cc20 con 0x7f39f80041e0 2020-02-12T14:12:44.019 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.005+0000 7f3a1d6d8700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39f80041e0 0x7f39f800b750 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f39f80048f0 tx=0x7f3a08002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.019 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.005+0000 7f3a1d6d8700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39f80041e0 0x7f39f800b750 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f39f80048f0 tx=0x7f3a08002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.019 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.005+0000 7f3a15ffb700 1 -- 172.21.15.139:0/718020413 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0800cd80 con 0x7f39f80041e0 2020-02-12T14:12:44.019 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.005+0000 7f3a15ffb700 1 -- 172.21.15.139:0/718020413 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a080066d0 con 0x7f39f80041e0 2020-02-12T14:12:44.019 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.005+0000 7f3a1d6d8700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39f80041e0 0x7f39f800b750 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f39f80048f0 tx=0x7f3a08002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.019 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.005+0000 7f3a15ffb700 1 -- 172.21.15.139:0/718020413 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f3a08002070 con 0x7f39f80041e0 2020-02-12T14:12:44.019 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.005+0000 7f3a1d6d8700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39f80041e0 0x7f39f800b750 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f39f80048f0 tx=0x7f3a08002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.019 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.005+0000 7f3a1f13b700 1 -- 172.21.15.139:0/718020413 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f39f4003580 con 0x7f39f80041e0 2020-02-12T14:12:44.020 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.006+0000 7f3a1d6d8700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39f80041e0 0x7f39f800b750 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f39f80048f0 tx=0x7f3a08002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.020 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.006+0000 7f3a15ffb700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f39f803ddd0 0x7f39f8040290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.020 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.006+0000 7f3a15ffb700 1 -- 172.21.15.139:0/718020413 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f3a08048f60 con 0x7f39f80041e0 2020-02-12T14:12:44.020 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.006+0000 7f3a1ced7700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f39f803ddd0 0x7f39f8040290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.020 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.006+0000 7f3a15ffb700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.139:6826/22149,v1:172.21.15.139:6827/22149] conn(0x7f39f80449f0 0x7f39f8046e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.020 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.006+0000 7f3a15ffb700 1 -- 172.21.15.139:0/718020413 --> [v2:172.21.15.139:6826/22149,v1:172.21.15.139:6827/22149] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f39f80473d0 con 0x7f39f80449f0 2020-02-12T14:12:44.020 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.006+0000 7f3a15ffb700 1 -- 172.21.15.139:0/718020413 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a0804a3e0 con 0x7f39f80041e0 2020-02-12T14:12:44.021 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.006+0000 7f3a17fff700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.139:6826/22149,v1:172.21.15.139:6827/22149] conn(0x7f39f80449f0 0x7f39f8046e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.021 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.006+0000 7f3a1ced7700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f39f803ddd0 0x7f39f8040290 crc :-1 s=READY pgs=61 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.021 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.006+0000 7f3a17fff700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.139:6826/22149,v1:172.21.15.139:6827/22149] conn(0x7f39f80449f0 0x7f39f8046e10 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.021 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.007+0000 7f3a15ffb700 1 -- 172.21.15.139:0/718020413 <== osd.2 v2:172.21.15.139:6826/22149 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f39f80473d0 con 0x7f39f80449f0 2020-02-12T14:12:44.026 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.024+0000 7f3a1f13b700 1 -- 172.21.15.139:0/718020413 --> [v2:172.21.15.139:6826/22149,v1:172.21.15.139:6827/22149] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f39f4002680 con 0x7f39f80449f0 2020-02-12T14:12:44.027 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.024+0000 7f3a15ffb700 1 -- 172.21.15.139:0/718020413 <== osd.2 v2:172.21.15.139:6826/22149 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f39f4002680 con 0x7f39f80449f0 2020-02-12T14:12:44.028 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.025+0000 7f3a1f13b700 1 -- 172.21.15.139:0/718020413 >> [v2:172.21.15.139:6826/22149,v1:172.21.15.139:6827/22149] conn(0x7f39f80449f0 msgr2=0x7f39f8046e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.028 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.025+0000 7f3a1f13b700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.139:6826/22149,v1:172.21.15.139:6827/22149] conn(0x7f39f80449f0 0x7f39f8046e10 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.028 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.025+0000 7f3a1f13b700 1 -- 172.21.15.139:0/718020413 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f39f803ddd0 msgr2=0x7f39f8040290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.028 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.025+0000 7f3a1f13b700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f39f803ddd0 0x7f39f8040290 crc :-1 s=READY pgs=61 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.028 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.025+0000 7f3a1f13b700 1 -- 172.21.15.139:0/718020413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39f80041e0 msgr2=0x7f39f800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.028 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.025+0000 7f3a1f13b700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39f80041e0 0x7f39f800b750 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7f39f80048f0 tx=0x7f3a08002e70).stop 2020-02-12T14:12:44.028 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.025+0000 7f3a1f13b700 1 -- 172.21.15.139:0/718020413 shutdown_connections 2020-02-12T14:12:44.029 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.025+0000 7f3a1f13b700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.139:6826/22149,v1:172.21.15.139:6827/22149] conn(0x7f39f80449f0 0x7f39f8046e10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.029 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.025+0000 7f3a1f13b700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f39f803ddd0 0x7f39f8040290 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.029 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.025+0000 7f3a1f13b700 1 --2- 172.21.15.139:0/718020413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39f80041e0 0x7f39f800b750 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.029 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.025+0000 7f3a1f13b700 1 -- 172.21.15.139:0/718020413 >> 172.21.15.139:0/718020413 conn(0x7f3a18060950 msgr2=0x7f3a1805e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:44.029 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.025+0000 7f3a1f13b700 1 -- 172.21.15.139:0/718020413 shutdown_connections 2020-02-12T14:12:44.029 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.025+0000 7f3a1f13b700 1 -- 172.21.15.139:0/718020413 wait complete. 2020-02-12T14:12:44.037 INFO:teuthology.orchestra.run.smithi139.stdout:55834574854 2020-02-12T14:12:44.037 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 flush_pg_stats 2020-02-12T14:12:44.143 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.141+0000 7fa24071d700 1 Processor -- start 2020-02-12T14:12:44.143 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.141+0000 7fa24071d700 1 -- start start 2020-02-12T14:12:44.145 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.142+0000 7fa24071d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa2380a7ac0 0x7fa2380a5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:44.145 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.142+0000 7fa24071d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2380a3db0 0x7fa2380a4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:44.146 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.142+0000 7fa24071d700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2380a2fb0 con 0x7fa2381315b0 2020-02-12T14:12:44.146 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.142+0000 7fa24071d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2380a2360 con 0x7fa2380a7ac0 2020-02-12T14:12:44.146 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.142+0000 7fa24071d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2380a5eb0 con 0x7fa2380a3db0 2020-02-12T14:12:44.146 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.142+0000 7fa23ecba700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fa2381315b0 0x7fa238131a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35464/0 (socket says 172.21.15.139:35464) 2020-02-12T14:12:44.146 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.142+0000 7fa23ecba700 1 -- 172.21.15.139:0/448922064 learned_addr learned my addr 172.21.15.139:0/448922064 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:44.146 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.142+0000 7fa23dcb8700 1 --2- 172.21.15.139:0/448922064 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2380a3db0 0x7fa2380a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.146 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.142+0000 7fa23e4b9700 1 --2- 172.21.15.139:0/448922064 >> v2:172.21.15.72:3300/0 conn(0x7fa2380a7ac0 0x7fa2380a5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.147 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.142+0000 7fa23e4b9700 1 -- 172.21.15.139:0/448922064 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2380a3db0 msgr2=0x7fa2380a4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:44.147 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.142+0000 7fa23e4b9700 1 --2- 172.21.15.139:0/448922064 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2380a3db0 0x7fa2380a4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:44.147 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.142+0000 7fa23e4b9700 1 -- 172.21.15.139:0/448922064 >> v1:172.21.15.139:6789/0 conn(0x7fa2381315b0 legacy=0x7fa238131a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.147 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.142+0000 7fa23e4b9700 1 -- 172.21.15.139:0/448922064 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2380a60f0 con 0x7fa2380a7ac0 2020-02-12T14:12:44.147 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.142+0000 7fa23dcb8700 1 --2- 172.21.15.139:0/448922064 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2380a3db0 0x7fa2380a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T14:12:44.147 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.142+0000 7fa23e4b9700 1 --2- 172.21.15.139:0/448922064 >> v2:172.21.15.72:3300/0 conn(0x7fa2380a7ac0 0x7fa2380a5a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa230002f30 tx=0x7fa2300088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.147 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.142+0000 7fa23e4b9700 1 --2- 172.21.15.139:0/448922064 >> v2:172.21.15.72:3300/0 conn(0x7fa2380a7ac0 0x7fa2380a5a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa230002f30 tx=0x7fa2300088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.148 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.142+0000 7fa23e4b9700 1 --2- 172.21.15.139:0/448922064 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2380a7ac0 0x7fa2380a5a50 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fa230002f30 tx=0x7fa2300088e0).ready entity=mon.0 client_cookie=918444cfbf74b4ef server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.151 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.144+0000 7fa23e4b9700 1 --2- 172.21.15.139:0/448922064 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2380a7ac0 0x7fa2380a5a50 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fa230002f30 tx=0x7fa2300088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.151 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.144+0000 7fa23d4b7700 1 -- 172.21.15.139:0/448922064 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa230008e40 con 0x7fa2380a7ac0 2020-02-12T14:12:44.151 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.144+0000 7fa23e4b9700 1 --2- 172.21.15.139:0/448922064 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2380a7ac0 0x7fa2380a5a50 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fa230002f30 tx=0x7fa2300088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.151 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.144+0000 7fa23d4b7700 1 -- 172.21.15.139:0/448922064 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2300115f0 con 0x7fa2380a7ac0 2020-02-12T14:12:44.151 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.144+0000 7fa23e4b9700 1 --2- 172.21.15.139:0/448922064 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2380a7ac0 0x7fa2380a5a50 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fa230002f30 tx=0x7fa2300088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.151 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.144+0000 7fa23d4b7700 1 -- 172.21.15.139:0/448922064 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2300119d0 con 0x7fa2380a7ac0 2020-02-12T14:12:44.151 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.144+0000 7fa24071d700 1 -- 172.21.15.139:0/448922064 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2380a7ac0 msgr2=0x7fa2380a5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.152 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.144+0000 7fa24071d700 1 --2- 172.21.15.139:0/448922064 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2380a7ac0 0x7fa2380a5a50 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fa230002f30 tx=0x7fa2300088e0).stop 2020-02-12T14:12:44.152 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.145+0000 7fa24071d700 1 -- 172.21.15.139:0/448922064 shutdown_connections 2020-02-12T14:12:44.152 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.145+0000 7fa24071d700 1 --2- 172.21.15.139:0/448922064 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2380a7ac0 0x7fa2380a5a50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.152 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.145+0000 7fa24071d700 1 --2- 172.21.15.139:0/448922064 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2380a3db0 0x7fa2380a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:44.152 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.145+0000 7fa24071d700 1 -- 172.21.15.139:0/448922064 >> 172.21.15.139:0/448922064 conn(0x7fa238060950 msgr2=0x7fa23809d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:44.152 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.145+0000 7fa24071d700 1 -- 172.21.15.139:0/448922064 shutdown_connections 2020-02-12T14:12:44.152 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.145+0000 7fa24071d700 1 -- 172.21.15.139:0/448922064 wait complete. 2020-02-12T14:12:44.152 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.146+0000 7fa24071d700 1 Processor -- start 2020-02-12T14:12:44.153 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.146+0000 7fa24071d700 1 -- start start 2020-02-12T14:12:44.153 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.146+0000 7fa24071d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa2380a3db0 0x7fa23812df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.153 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.146+0000 7fa24071d700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa2380a7ac0 0x7fa238066520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.153 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.146+0000 7fa24071d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2381315b0 0x7fa238148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.153 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.146+0000 7fa24071d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa238065e50 con 0x7fa2380a3db0 2020-02-12T14:12:44.153 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.146+0000 7fa24071d700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2380671a0 con 0x7fa2380a7ac0 2020-02-12T14:12:44.153 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.146+0000 7fa24071d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23812e640 con 0x7fa2381315b0 2020-02-12T14:12:44.154 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.146+0000 7fa23dcb8700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa2380a7ac0 0x7fa238066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.154 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.146+0000 7fa23dcb8700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa2380a7ac0 0x7fa238066520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46830/0 (socket says 172.21.15.139:46830) 2020-02-12T14:12:44.154 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.146+0000 7fa23dcb8700 1 -- 172.21.15.139:0/2691067820 learned_addr learned my addr 172.21.15.139:0/2691067820 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:44.154 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.146+0000 7fa23e4b9700 1 --2- 172.21.15.139:0/2691067820 >> v2:172.21.15.72:3300/0 conn(0x7fa2380a3db0 0x7fa23812df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.154 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.146+0000 7fa23ecba700 1 --2- 172.21.15.139:0/2691067820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2381315b0 0x7fa238148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.154 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.147+0000 7fa23dcb8700 1 -- 172.21.15.139:0/2691067820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2381315b0 msgr2=0x7fa238148da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.154 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.147+0000 7fa23dcb8700 1 --2- 172.21.15.139:0/2691067820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2381315b0 0x7fa238148da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.155 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.147+0000 7fa23dcb8700 1 -- 172.21.15.139:0/2691067820 >> v2:172.21.15.72:3300/0 conn(0x7fa2380a3db0 msgr2=0x7fa23812df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.155 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.147+0000 7fa23dcb8700 1 --2- 172.21.15.139:0/2691067820 >> v2:172.21.15.72:3300/0 conn(0x7fa2380a3db0 0x7fa23812df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.155 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.147+0000 7fa23dcb8700 1 -- 172.21.15.139:0/2691067820 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa238066080 con 0x7fa2380a7ac0 2020-02-12T14:12:44.155 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.147+0000 7fa23ecba700 1 --2- 172.21.15.139:0/2691067820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2381315b0 0x7fa238148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T14:12:44.155 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.147+0000 7fa23dcb8700 1 --2- 172.21.15.139:0/2691067820 >> v2:172.21.15.139:3300/0 conn(0x7fa2380a7ac0 0x7fa238066520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa220003270 tx=0x7fa220011230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.155 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.147+0000 7fa23dcb8700 1 --2- 172.21.15.139:0/2691067820 >> v2:172.21.15.139:3300/0 conn(0x7fa2380a7ac0 0x7fa238066520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa220003270 tx=0x7fa220011230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.155 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.147+0000 7fa23dcb8700 1 --2- 172.21.15.139:0/2691067820 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2380a7ac0 0x7fa238066520 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7fa220003270 tx=0x7fa220011230).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.157 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.149+0000 7fa23dcb8700 1 --2- 172.21.15.139:0/2691067820 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2380a7ac0 0x7fa238066520 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fa220003270 tx=0x7fa220011230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.157 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.149+0000 7fa23dcb8700 1 --2- 172.21.15.139:0/2691067820 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2380a7ac0 0x7fa238066520 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fa220003270 tx=0x7fa220011230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.158 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.149+0000 7fa23dcb8700 1 --2- 172.21.15.139:0/2691067820 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2380a7ac0 0x7fa238066520 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fa220003270 tx=0x7fa220011230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.158 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.149+0000 7fa2377fe700 1 -- 172.21.15.139:0/2691067820 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa22000eae0 con 0x7fa2380a7ac0 2020-02-12T14:12:44.158 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.149+0000 7fa2377fe700 1 -- 172.21.15.139:0/2691067820 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22000ec80 con 0x7fa2380a7ac0 2020-02-12T14:12:44.158 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.149+0000 7fa2377fe700 1 -- 172.21.15.139:0/2691067820 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa220012a80 con 0x7fa2380a7ac0 2020-02-12T14:12:44.158 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.149+0000 7fa24071d700 1 -- 172.21.15.139:0/2691067820 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23812e390 con 0x7fa2380a7ac0 2020-02-12T14:12:44.158 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.149+0000 7fa24071d700 1 -- 172.21.15.139:0/2691067820 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa238066980 con 0x7fa2380a7ac0 2020-02-12T14:12:44.158 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.150+0000 7fa23dcb8700 1 --2- 172.21.15.139:0/2691067820 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2380a7ac0 0x7fa238066520 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fa220003270 tx=0x7fa220011230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.159 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.150+0000 7fa2377fe700 1 -- 172.21.15.139:0/2691067820 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fa220012cf0 con 0x7fa2380a7ac0 2020-02-12T14:12:44.159 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.150+0000 7fa23dcb8700 1 --2- 172.21.15.139:0/2691067820 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2380a7ac0 0x7fa238066520 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fa220003270 tx=0x7fa220011230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.159 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.150+0000 7fa24071d700 1 -- 172.21.15.139:0/2691067820 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa238066210 con 0x7fa2380a7ac0 2020-02-12T14:12:44.159 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.150+0000 7fa2377fe700 1 --2- 172.21.15.139:0/2691067820 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fa21c039c40 0x7fa21c03c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.159 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.150+0000 7fa2377fe700 1 -- 172.21.15.139:0/2691067820 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fa220049c10 con 0x7fa2380a7ac0 2020-02-12T14:12:44.159 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.150+0000 7fa23dcb8700 1 --2- 172.21.15.139:0/2691067820 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2380a7ac0 0x7fa238066520 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fa220003270 tx=0x7fa220011230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.159 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.150+0000 7fa2377fe700 1 --2- 172.21.15.139:0/2691067820 >> [v2:172.21.15.139:6814/22150,v1:172.21.15.139:6816/22150] conn(0x7fa21c040890 0x7fa21c042cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.160 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.150+0000 7fa23e4b9700 1 --2- 172.21.15.139:0/2691067820 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fa21c039c40 0x7fa21c03c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.160 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.150+0000 7fa2377fe700 1 -- 172.21.15.139:0/2691067820 --> [v2:172.21.15.139:6814/22150,v1:172.21.15.139:6816/22150] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa21c043270 con 0x7fa21c040890 2020-02-12T14:12:44.160 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.150+0000 7fa2377fe700 1 -- 172.21.15.139:0/2691067820 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa22002f0f0 con 0x7fa2380a7ac0 2020-02-12T14:12:44.160 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.150+0000 7fa23ecba700 1 --2- 172.21.15.139:0/2691067820 >> [v2:172.21.15.139:6814/22150,v1:172.21.15.139:6816/22150] conn(0x7fa21c040890 0x7fa21c042cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.160 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.150+0000 7fa23e4b9700 1 --2- 172.21.15.139:0/2691067820 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fa21c039c40 0x7fa21c03c100 crc :-1 s=READY pgs=62 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.160 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.150+0000 7fa23ecba700 1 --2- 172.21.15.139:0/2691067820 >> [v2:172.21.15.139:6814/22150,v1:172.21.15.139:6816/22150] conn(0x7fa21c040890 0x7fa21c042cb0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.160 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.151+0000 7fa2377fe700 1 -- 172.21.15.139:0/2691067820 <== osd.3 v2:172.21.15.139:6814/22150 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7fa21c043270 con 0x7fa21c040890 2020-02-12T14:12:44.170 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.168+0000 7fa24071d700 1 -- 172.21.15.139:0/2691067820 --> [v2:172.21.15.139:6814/22150,v1:172.21.15.139:6816/22150] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa2380a9270 con 0x7fa21c040890 2020-02-12T14:12:44.171 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.168+0000 7fa2377fe700 1 -- 172.21.15.139:0/2691067820 <== osd.3 v2:172.21.15.139:6814/22150 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa2380a9270 con 0x7fa21c040890 2020-02-12T14:12:44.172 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.169+0000 7fa24071d700 1 -- 172.21.15.139:0/2691067820 >> [v2:172.21.15.139:6814/22150,v1:172.21.15.139:6816/22150] conn(0x7fa21c040890 msgr2=0x7fa21c042cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.172 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.169+0000 7fa24071d700 1 --2- 172.21.15.139:0/2691067820 >> [v2:172.21.15.139:6814/22150,v1:172.21.15.139:6816/22150] conn(0x7fa21c040890 0x7fa21c042cb0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.172 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.169+0000 7fa24071d700 1 -- 172.21.15.139:0/2691067820 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fa21c039c40 msgr2=0x7fa21c03c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.172 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.169+0000 7fa24071d700 1 --2- 172.21.15.139:0/2691067820 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fa21c039c40 0x7fa21c03c100 crc :-1 s=READY pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.172 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.169+0000 7fa24071d700 1 -- 172.21.15.139:0/2691067820 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2380a7ac0 msgr2=0x7fa238066520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.172 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.169+0000 7fa24071d700 1 --2- 172.21.15.139:0/2691067820 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2380a7ac0 0x7fa238066520 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7fa220003270 tx=0x7fa220011230).stop 2020-02-12T14:12:44.173 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.169+0000 7fa23ecba700 1 -- 172.21.15.139:0/2691067820 reap_dead start 2020-02-12T14:12:44.173 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.169+0000 7fa24071d700 1 -- 172.21.15.139:0/2691067820 shutdown_connections 2020-02-12T14:12:44.173 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.169+0000 7fa24071d700 1 --2- 172.21.15.139:0/2691067820 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2380a7ac0 0x7fa238066520 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.173 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.169+0000 7fa24071d700 1 -- 172.21.15.139:0/2691067820 >> 172.21.15.139:0/2691067820 conn(0x7fa238060950 msgr2=0x7fa23805e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:44.173 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.169+0000 7fa24071d700 1 -- 172.21.15.139:0/2691067820 shutdown_connections 2020-02-12T14:12:44.173 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.169+0000 7fa24071d700 1 -- 172.21.15.139:0/2691067820 wait complete. 2020-02-12T14:12:44.181 INFO:teuthology.orchestra.run.smithi139.stdout:55834574854 2020-02-12T14:12:44.181 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 flush_pg_stats 2020-02-12T14:12:44.286 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.284+0000 7f260d1a1700 1 Processor -- start 2020-02-12T14:12:44.287 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.284+0000 7f260d1a1700 1 -- start start 2020-02-12T14:12:44.294 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.285+0000 7f260d1a1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2608135500 0x7f26080a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:44.294 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.285+0000 7f260d1a1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26081359e0 con 0x7f26080a3f40 2020-02-12T14:12:44.294 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.285+0000 7f260d1a1700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2608135c80 con 0x7f26080a21f0 2020-02-12T14:12:44.294 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.285+0000 7f260d1a1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26080a18f0 con 0x7f2608135500 2020-02-12T14:12:44.295 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.285+0000 7f260759e700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f26080a21f0 0x7f260812e6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35476/0 (socket says 172.21.15.139:35476) 2020-02-12T14:12:44.295 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.285+0000 7f260759e700 1 -- 172.21.15.139:0/2387127146 learned_addr learned my addr 172.21.15.139:0/2387127146 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:44.295 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.285+0000 7f260659c700 1 --2- 172.21.15.139:0/2387127146 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2608135500 0x7f26080a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.295 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.285+0000 7f2605d9b700 1 -- 172.21.15.139:0/2387127146 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3811857184 0 0) 0x7f2608135c80 con 0x7f26080a21f0 2020-02-12T14:12:44.295 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f2605d9b700 1 -- 172.21.15.139:0/2387127146 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25ec003230 con 0x7f26080a21f0 2020-02-12T14:12:44.295 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f2605d9b700 1 -- 172.21.15.139:0/2387127146 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1329294127 0 0) 0x7f25ec003230 con 0x7f26080a21f0 2020-02-12T14:12:44.295 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f2605d9b700 1 -- 172.21.15.139:0/2387127146 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2608135500 msgr2=0x7f26080a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:44.296 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f2605d9b700 1 --2- 172.21.15.139:0/2387127146 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2608135500 0x7f26080a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:44.296 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f2605d9b700 1 -- 172.21.15.139:0/2387127146 >> v1:172.21.15.72:6789/0 conn(0x7f26080a3f40 legacy=0x7f2608134df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.296 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f2605d9b700 1 -- 172.21.15.139:0/2387127146 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26080a2680 con 0x7f26080a21f0 2020-02-12T14:12:44.296 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f2605d9b700 1 -- 172.21.15.139:0/2387127146 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7f2600001a50 con 0x7f26080a21f0 2020-02-12T14:12:44.296 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f2605d9b700 1 -- 172.21.15.139:0/2387127146 >> v1:172.21.15.139:6789/0 conn(0x7f26080a21f0 legacy=0x7f260812e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.296 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f2605d9b700 1 --2- 172.21.15.139:0/2387127146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25ec003750 0x7f25ec003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:44.296 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f2605d9b700 1 --2- 172.21.15.139:0/2387127146 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2608135500 0x7f25ec0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:44.297 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f2605d9b700 1 --2- 172.21.15.139:0/2387127146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25ec004930 0x7f25ec004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:44.297 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f2605d9b700 1 -- 172.21.15.139:0/2387127146 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26080a18f0 con 0x7f25ec003750 2020-02-12T14:12:44.297 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f2605d9b700 1 -- 172.21.15.139:0/2387127146 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec005330 con 0x7f25ec004930 2020-02-12T14:12:44.297 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f2605d9b700 1 -- 172.21.15.139:0/2387127146 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec004150 con 0x7f2608135500 2020-02-12T14:12:44.297 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f260759e700 1 --2- 172.21.15.139:0/2387127146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25ec004930 0x7f25ec004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.297 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f2606d9d700 1 --2- 172.21.15.139:0/2387127146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25ec003750 0x7f25ec003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.297 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f260659c700 1 --2- 172.21.15.139:0/2387127146 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2608135500 0x7f25ec0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.297 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f260759e700 1 -- 172.21.15.139:0/2387127146 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2608135500 msgr2=0x7f25ec0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:44.298 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f260759e700 1 --2- 172.21.15.139:0/2387127146 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2608135500 0x7f25ec0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:44.298 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f260759e700 1 -- 172.21.15.139:0/2387127146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25ec003750 msgr2=0x7f25ec003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:44.298 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f260759e700 1 --2- 172.21.15.139:0/2387127146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25ec003750 0x7f25ec003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:44.298 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f260759e700 1 -- 172.21.15.139:0/2387127146 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ec003230 con 0x7f25ec004930 2020-02-12T14:12:44.298 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f260759e700 1 --2- 172.21.15.139:0/2387127146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25ec004930 0x7f25ec004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2600001760 tx=0x7f26080a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.298 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f260759e700 1 --2- 172.21.15.139:0/2387127146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25ec004930 0x7f25ec004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2600001760 tx=0x7f26080a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.298 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f260759e700 1 --2- 172.21.15.139:0/2387127146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25ec004930 0x7f25ec004db0 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7f2600001760 tx=0x7f26080a2810).ready entity=mon.1 client_cookie=8ffbb6b96d461d5b server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.299 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f260759e700 1 --2- 172.21.15.139:0/2387127146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25ec004930 0x7f25ec004db0 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f2600001760 tx=0x7f26080a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.299 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f2605d9b700 1 -- 172.21.15.139:0/2387127146 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2600005d40 con 0x7f25ec004930 2020-02-12T14:12:44.299 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f260759e700 1 --2- 172.21.15.139:0/2387127146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25ec004930 0x7f25ec004db0 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f2600001760 tx=0x7f26080a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.299 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f2605d9b700 1 -- 172.21.15.139:0/2387127146 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260000e160 con 0x7f25ec004930 2020-02-12T14:12:44.299 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f260759e700 1 --2- 172.21.15.139:0/2387127146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25ec004930 0x7f25ec004db0 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f2600001760 tx=0x7f26080a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.299 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f2605d9b700 1 -- 172.21.15.139:0/2387127146 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2600005ea0 con 0x7f25ec004930 2020-02-12T14:12:44.299 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f260d1a1700 1 -- 172.21.15.139:0/2387127146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25ec004930 msgr2=0x7f25ec004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.300 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f260d1a1700 1 --2- 172.21.15.139:0/2387127146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25ec004930 0x7f25ec004db0 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7f2600001760 tx=0x7f26080a2810).stop 2020-02-12T14:12:44.300 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.286+0000 7f260759e700 1 -- 172.21.15.139:0/2387127146 reap_dead start 2020-02-12T14:12:44.300 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.287+0000 7f260d1a1700 1 -- 172.21.15.139:0/2387127146 shutdown_connections 2020-02-12T14:12:44.300 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.287+0000 7f260d1a1700 1 -- 172.21.15.139:0/2387127146 >> 172.21.15.139:0/2387127146 conn(0x7f2608060950 msgr2=0x7f260809d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:44.300 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.287+0000 7f260d1a1700 1 -- 172.21.15.139:0/2387127146 shutdown_connections 2020-02-12T14:12:44.300 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.287+0000 7f260d1a1700 1 -- 172.21.15.139:0/2387127146 wait complete. 2020-02-12T14:12:44.300 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.288+0000 7f260d1a1700 1 Processor -- start 2020-02-12T14:12:44.301 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.288+0000 7f260d1a1700 1 -- start start 2020-02-12T14:12:44.301 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.288+0000 7f260d1a1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2608130d20 0x7f26081344d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.301 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.288+0000 7f260d1a1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f260812bd80 0x7f260814cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.301 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.288+0000 7f260d1a1700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26080a7880 con 0x7f260812f7b0 2020-02-12T14:12:44.301 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.288+0000 7f260d1a1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26080a4b20 con 0x7f260812bd80 2020-02-12T14:12:44.301 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.288+0000 7f260d1a1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260812fc10 con 0x7f2608130d20 2020-02-12T14:12:44.301 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.288+0000 7f260659c700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f260812f7b0 0x7f260812b670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35486/0 (socket says 172.21.15.139:35486) 2020-02-12T14:12:44.301 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.289+0000 7f260659c700 1 -- 172.21.15.139:0/1589584989 learned_addr learned my addr 172.21.15.139:0/1589584989 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:44.302 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.289+0000 7f2606d9d700 1 --2- 172.21.15.139:0/1589584989 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2608130d20 0x7f26081344d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.302 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.289+0000 7f260759e700 1 --2- 172.21.15.139:0/1589584989 >> v2:172.21.15.72:3300/0 conn(0x7f260812bd80 0x7f260814cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.302 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.289+0000 7f25f7fff700 1 -- 172.21.15.139:0/1589584989 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1289142966 0 0) 0x7f26080a7880 con 0x7f260812f7b0 2020-02-12T14:12:44.302 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.289+0000 7f25f7fff700 1 -- 172.21.15.139:0/1589584989 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25e4002fe0 con 0x7f260812f7b0 2020-02-12T14:12:44.302 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.289+0000 7f260759e700 1 -- 172.21.15.139:0/1589584989 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2608130d20 msgr2=0x7f26081344d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.302 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.289+0000 7f260759e700 1 --2- 172.21.15.139:0/1589584989 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2608130d20 0x7f26081344d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.302 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.289+0000 7f260759e700 1 -- 172.21.15.139:0/1589584989 >> v1:172.21.15.139:6789/0 conn(0x7f260812f7b0 legacy=0x7f260812b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.303 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.289+0000 7f25f7fff700 1 -- 172.21.15.139:0/1589584989 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2016498713 0 0) 0x7f25e4002fe0 con 0x7f260812f7b0 2020-02-12T14:12:44.303 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.289+0000 7f260759e700 1 -- 172.21.15.139:0/1589584989 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2608130790 con 0x7f260812bd80 2020-02-12T14:12:44.303 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.289+0000 7f2606d9d700 1 --2- 172.21.15.139:0/1589584989 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2608130d20 0x7f26081344d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T14:12:44.303 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.289+0000 7f260759e700 1 --2- 172.21.15.139:0/1589584989 >> v2:172.21.15.72:3300/0 conn(0x7f260812bd80 0x7f260814cd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f25fc001670 tx=0x7f26080a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.303 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.289+0000 7f260759e700 1 --2- 172.21.15.139:0/1589584989 >> v2:172.21.15.72:3300/0 conn(0x7f260812bd80 0x7f260814cd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f25fc001670 tx=0x7f26080a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.303 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.289+0000 7f260759e700 1 --2- 172.21.15.139:0/1589584989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f260812bd80 0x7f260814cd90 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f25fc001670 tx=0x7f26080a2810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.303 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.289+0000 7f260759e700 1 --2- 172.21.15.139:0/1589584989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f260812bd80 0x7f260814cd90 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f25fc001670 tx=0x7f26080a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.304 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.289+0000 7f25f7fff700 1 -- 172.21.15.139:0/1589584989 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25fc001490 con 0x7f260812bd80 2020-02-12T14:12:44.304 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.289+0000 7f260759e700 1 --2- 172.21.15.139:0/1589584989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f260812bd80 0x7f260814cd90 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f25fc001670 tx=0x7f26080a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.304 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.289+0000 7f25f7fff700 1 -- 172.21.15.139:0/1589584989 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260000e370 con 0x7f260812bd80 2020-02-12T14:12:44.304 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.289+0000 7f260759e700 1 --2- 172.21.15.139:0/1589584989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f260812bd80 0x7f260814cd90 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f25fc001670 tx=0x7f26080a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.304 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.289+0000 7f260d1a1700 1 -- 172.21.15.139:0/1589584989 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26081302c0 con 0x7f260812bd80 2020-02-12T14:12:44.304 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.289+0000 7f25f7fff700 1 -- 172.21.15.139:0/1589584989 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f260000e6d0 con 0x7f260812bd80 2020-02-12T14:12:44.304 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.289+0000 7f260d1a1700 1 -- 172.21.15.139:0/1589584989 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26081304f0 con 0x7f260812bd80 2020-02-12T14:12:44.304 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.290+0000 7f260759e700 1 --2- 172.21.15.139:0/1589584989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f260812bd80 0x7f260814cd90 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f25fc001670 tx=0x7f26080a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.305 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.290+0000 7f260d1a1700 1 -- 172.21.15.139:0/1589584989 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2608134230 con 0x7f260812bd80 2020-02-12T14:12:44.305 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.290+0000 7f25f7fff700 1 -- 172.21.15.139:0/1589584989 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f2600001510 con 0x7f260812bd80 2020-02-12T14:12:44.305 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.290+0000 7f260759e700 1 --2- 172.21.15.139:0/1589584989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f260812bd80 0x7f260814cd90 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f25fc001670 tx=0x7f26080a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.305 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.290+0000 7f260759e700 1 --2- 172.21.15.139:0/1589584989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f260812bd80 0x7f260814cd90 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f25fc001670 tx=0x7f26080a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.305 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.290+0000 7f25f7fff700 1 --2- 172.21.15.139:0/1589584989 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f25e4039e60 0x7f25e403c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.305 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.290+0000 7f25f7fff700 1 -- 172.21.15.139:0/1589584989 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f26000498f0 con 0x7f260812bd80 2020-02-12T14:12:44.305 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.291+0000 7f2606d9d700 1 --2- 172.21.15.139:0/1589584989 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f25e4039e60 0x7f25e403c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.306 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.291+0000 7f25f7fff700 1 --2- 172.21.15.139:0/1589584989 >> [v2:172.21.15.72:6800/21598,v1:172.21.15.72:6801/21598] conn(0x7f25e4040ab0 0x7f25e4042ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.306 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.291+0000 7f25f7fff700 1 -- 172.21.15.139:0/1589584989 --> [v2:172.21.15.72:6800/21598,v1:172.21.15.72:6801/21598] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f25e4043490 con 0x7f25e4040ab0 2020-02-12T14:12:44.306 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.291+0000 7f25f7fff700 1 -- 172.21.15.139:0/1589584989 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f260004adb0 con 0x7f260812bd80 2020-02-12T14:12:44.306 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.291+0000 7f2606d9d700 1 --2- 172.21.15.139:0/1589584989 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f25e4039e60 0x7f25e403c320 crc :-1 s=READY pgs=63 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.306 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.291+0000 7f260659c700 1 --2- 172.21.15.139:0/1589584989 >> [v2:172.21.15.72:6800/21598,v1:172.21.15.72:6801/21598] conn(0x7f25e4040ab0 0x7f25e4042ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.306 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.291+0000 7f260659c700 1 --2- 172.21.15.139:0/1589584989 >> [v2:172.21.15.72:6800/21598,v1:172.21.15.72:6801/21598] conn(0x7f25e4040ab0 0x7f25e4042ed0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.306 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.292+0000 7f25f7fff700 1 -- 172.21.15.139:0/1589584989 <== osd.4 v2:172.21.15.72:6800/21598 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f25e4043490 con 0x7f25e4040ab0 2020-02-12T14:12:44.311 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.309+0000 7f260d1a1700 1 -- 172.21.15.139:0/1589584989 --> [v2:172.21.15.72:6800/21598,v1:172.21.15.72:6801/21598] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f26080a9180 con 0x7f25e4040ab0 2020-02-12T14:12:44.313 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.311+0000 7f25f7fff700 1 -- 172.21.15.139:0/1589584989 <== osd.4 v2:172.21.15.72:6800/21598 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f26080a9180 con 0x7f25e4040ab0 2020-02-12T14:12:44.313 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.311+0000 7f260d1a1700 1 -- 172.21.15.139:0/1589584989 >> [v2:172.21.15.72:6800/21598,v1:172.21.15.72:6801/21598] conn(0x7f25e4040ab0 msgr2=0x7f25e4042ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.313 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.311+0000 7f260d1a1700 1 --2- 172.21.15.139:0/1589584989 >> [v2:172.21.15.72:6800/21598,v1:172.21.15.72:6801/21598] conn(0x7f25e4040ab0 0x7f25e4042ed0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.313 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.311+0000 7f260d1a1700 1 -- 172.21.15.139:0/1589584989 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f25e4039e60 msgr2=0x7f25e403c320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.314 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.311+0000 7f260d1a1700 1 --2- 172.21.15.139:0/1589584989 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f25e4039e60 0x7f25e403c320 crc :-1 s=READY pgs=63 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.314 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.311+0000 7f260d1a1700 1 -- 172.21.15.139:0/1589584989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f260812bd80 msgr2=0x7f260814cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.314 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.311+0000 7f260d1a1700 1 --2- 172.21.15.139:0/1589584989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f260812bd80 0x7f260814cd90 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f25fc001670 tx=0x7f26080a2810).stop 2020-02-12T14:12:44.314 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.311+0000 7f260759e700 1 -- 172.21.15.139:0/1589584989 reap_dead start 2020-02-12T14:12:44.314 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.311+0000 7f260d1a1700 1 -- 172.21.15.139:0/1589584989 shutdown_connections 2020-02-12T14:12:44.314 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.311+0000 7f260d1a1700 1 --2- 172.21.15.139:0/1589584989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f260812bd80 0x7f260814cd90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.315 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.311+0000 7f260d1a1700 1 -- 172.21.15.139:0/1589584989 >> 172.21.15.139:0/1589584989 conn(0x7f2608060950 msgr2=0x7f260805e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:44.315 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.311+0000 7f260d1a1700 1 -- 172.21.15.139:0/1589584989 shutdown_connections 2020-02-12T14:12:44.315 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.311+0000 7f260d1a1700 1 -- 172.21.15.139:0/1589584989 wait complete. 2020-02-12T14:12:44.322 INFO:teuthology.orchestra.run.smithi139.stdout:55834574853 2020-02-12T14:12:44.323 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 flush_pg_stats 2020-02-12T14:12:44.428 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.426+0000 7f2157925700 1 Processor -- start 2020-02-12T14:12:44.428 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.426+0000 7f2157925700 1 -- start start 2020-02-12T14:12:44.431 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.427+0000 7f2157925700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21500a7ac0 0x7f21500a5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:44.432 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.427+0000 7f2157925700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f21500a4230 0x7f2150131cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:44.432 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.427+0000 7f2157925700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21500a2fb0 con 0x7f21500a3db0 2020-02-12T14:12:44.432 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.427+0000 7f2157925700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21500a2360 con 0x7f21500a4230 2020-02-12T14:12:44.432 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.427+0000 7f2157925700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21500a5eb0 con 0x7f21500a7ac0 2020-02-12T14:12:44.432 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.427+0000 7f21556c1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21500a7ac0 0x7f21500a5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.432 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.427+0000 7f2155ec2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f21500a4230 0x7f2150131cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.433 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.427+0000 7f21556c1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21500a7ac0 0x7f21500a5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.139:39442/0 (socket says 172.21.15.139:39442) 2020-02-12T14:12:44.433 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.427+0000 7f2155ec2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f21500a4230 0x7f2150131cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.139:49770/0 (socket says 172.21.15.139:49770) 2020-02-12T14:12:44.433 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.427+0000 7f21556c1700 1 -- 172.21.15.139:0/2589292284 learned_addr learned my addr 172.21.15.139:0/2589292284 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:44.433 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.427+0000 7f2154ec0700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f21500a3db0 0x7f21501315b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.139:49370/0 (socket says 172.21.15.139:49370) 2020-02-12T14:12:44.433 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.427+0000 7f21556c1700 1 -- 172.21.15.139:0/2589292284 >> v2:172.21.15.72:3300/0 conn(0x7f21500a4230 msgr2=0x7f2150131cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:44.433 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.427+0000 7f21556c1700 1 --2- 172.21.15.139:0/2589292284 >> v2:172.21.15.72:3300/0 conn(0x7f21500a4230 0x7f2150131cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:44.433 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.427+0000 7f21556c1700 1 -- 172.21.15.139:0/2589292284 >> v1:172.21.15.72:6789/0 conn(0x7f21500a3db0 legacy=0x7f21501315b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.434 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.427+0000 7f21556c1700 1 -- 172.21.15.139:0/2589292284 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21500a60f0 con 0x7f21500a7ac0 2020-02-12T14:12:44.434 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.427+0000 7f2155ec2700 1 --2- 172.21.15.139:0/2589292284 >> v2:172.21.15.72:3300/0 conn(0x7f21500a4230 0x7f2150131cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T14:12:44.434 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.428+0000 7f21556c1700 1 --2- 172.21.15.139:0/2589292284 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21500a7ac0 0x7f21500a5a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2140002f30 tx=0x7f21400088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.434 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.428+0000 7f21556c1700 1 --2- 172.21.15.139:0/2589292284 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21500a7ac0 0x7f21500a5a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2140002f30 tx=0x7f21400088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.434 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.428+0000 7f21556c1700 1 --2- 172.21.15.139:0/2589292284 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21500a7ac0 0x7f21500a5a50 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7f2140002f30 tx=0x7f21400088e0).ready entity=mon.2 client_cookie=1c8a78339b89b9f6 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.434 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.428+0000 7f21556c1700 1 --2- 172.21.15.139:0/2589292284 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21500a7ac0 0x7f21500a5a50 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f2140002f30 tx=0x7f21400088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.434 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.428+0000 7f21556c1700 1 --2- 172.21.15.139:0/2589292284 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21500a7ac0 0x7f21500a5a50 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f2140002f30 tx=0x7f21400088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.434 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.428+0000 7f213ffff700 1 -- 172.21.15.139:0/2589292284 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2140011860 con 0x7f21500a7ac0 2020-02-12T14:12:44.435 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.428+0000 7f21556c1700 1 --2- 172.21.15.139:0/2589292284 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21500a7ac0 0x7f21500a5a50 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f2140002f30 tx=0x7f21400088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.435 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.428+0000 7f213ffff700 1 -- 172.21.15.139:0/2589292284 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21400119c0 con 0x7f21500a7ac0 2020-02-12T14:12:44.435 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.428+0000 7f213ffff700 1 -- 172.21.15.139:0/2589292284 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2140011da0 con 0x7f21500a7ac0 2020-02-12T14:12:44.435 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.428+0000 7f2157925700 1 -- 172.21.15.139:0/2589292284 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21500a7ac0 msgr2=0x7f21500a5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.435 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.428+0000 7f2157925700 1 --2- 172.21.15.139:0/2589292284 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21500a7ac0 0x7f21500a5a50 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7f2140002f30 tx=0x7f21400088e0).stop 2020-02-12T14:12:44.435 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.428+0000 7f2157925700 1 -- 172.21.15.139:0/2589292284 shutdown_connections 2020-02-12T14:12:44.435 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.428+0000 7f2157925700 1 --2- 172.21.15.139:0/2589292284 >> v2:172.21.15.72:3300/0 conn(0x7f21500a4230 0x7f2150131cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:44.436 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.428+0000 7f2157925700 1 --2- 172.21.15.139:0/2589292284 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21500a7ac0 0x7f21500a5a50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.436 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.428+0000 7f2157925700 1 -- 172.21.15.139:0/2589292284 >> 172.21.15.139:0/2589292284 conn(0x7f2150060950 msgr2=0x7f215009d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:44.436 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.428+0000 7f2157925700 1 -- 172.21.15.139:0/2589292284 shutdown_connections 2020-02-12T14:12:44.436 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.428+0000 7f2157925700 1 -- 172.21.15.139:0/2589292284 wait complete. 2020-02-12T14:12:44.436 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.429+0000 7f2157925700 1 Processor -- start 2020-02-12T14:12:44.436 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.429+0000 7f2157925700 1 -- start start 2020-02-12T14:12:44.440 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.430+0000 7f2157925700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f21500a4230 0x7f2150143420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.440 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.430+0000 7f2157925700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21500a7ac0 0x7f2150134530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.440 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.430+0000 7f2157925700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2150134990 con 0x7f21500a3db0 2020-02-12T14:12:44.440 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.430+0000 7f2157925700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2150146c20 con 0x7f21500a4230 2020-02-12T14:12:44.440 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.430+0000 7f2157925700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2150146ec0 con 0x7f21500a7ac0 2020-02-12T14:12:44.440 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.430+0000 7f2155ec2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21500a7ac0 0x7f2150134530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.441 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.430+0000 7f2154ec0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f21500a4230 0x7f2150143420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.441 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.430+0000 7f21556c1700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f21500a3db0 0x7f2150147360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.139:49378/0 (socket says 172.21.15.139:49378) 2020-02-12T14:12:44.441 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.430+0000 7f2155ec2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21500a7ac0 0x7f2150134530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.139:39450/0 (socket says 172.21.15.139:39450) 2020-02-12T14:12:44.441 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.430+0000 7f21556c1700 1 -- 172.21.15.139:0/471794052 learned_addr learned my addr 172.21.15.139:0/471794052 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:44.441 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.430+0000 7f2154ec0700 1 -- 172.21.15.139:0/471794052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21500a7ac0 msgr2=0x7f2150134530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.441 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.430+0000 7f2154ec0700 1 --2- 172.21.15.139:0/471794052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21500a7ac0 0x7f2150134530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.441 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.430+0000 7f2154ec0700 1 -- 172.21.15.139:0/471794052 >> v1:172.21.15.72:6789/0 conn(0x7f21500a3db0 legacy=0x7f2150147360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.442 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.430+0000 7f213e7fc700 1 -- 172.21.15.139:0/471794052 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3252362800 0 0) 0x7f21500a60f0 con 0x7f21500a3db0 2020-02-12T14:12:44.442 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.430+0000 7f2154ec0700 1 -- 172.21.15.139:0/471794052 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2150135570 con 0x7f21500a4230 2020-02-12T14:12:44.442 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.430+0000 7f2155ec2700 1 --2- 172.21.15.139:0/471794052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21500a7ac0 0x7f2150134530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T14:12:44.442 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.430+0000 7f2154ec0700 1 --2- 172.21.15.139:0/471794052 >> v2:172.21.15.72:3300/0 conn(0x7f21500a4230 0x7f2150143420 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f21500a5750 tx=0x7f214c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.442 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.431+0000 7f2154ec0700 1 --2- 172.21.15.139:0/471794052 >> v2:172.21.15.72:3300/0 conn(0x7f21500a4230 0x7f2150143420 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f21500a5750 tx=0x7f214c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.442 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.431+0000 7f2154ec0700 1 --2- 172.21.15.139:0/471794052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21500a4230 0x7f2150143420 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f21500a5750 tx=0x7f214c010900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.442 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.431+0000 7f2154ec0700 1 --2- 172.21.15.139:0/471794052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21500a4230 0x7f2150143420 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f21500a5750 tx=0x7f214c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.443 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.431+0000 7f213e7fc700 1 -- 172.21.15.139:0/471794052 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f214c011610 con 0x7f21500a4230 2020-02-12T14:12:44.443 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.431+0000 7f2154ec0700 1 --2- 172.21.15.139:0/471794052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21500a4230 0x7f2150143420 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f21500a5750 tx=0x7f214c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.443 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.431+0000 7f2154ec0700 1 --2- 172.21.15.139:0/471794052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21500a4230 0x7f2150143420 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f21500a5750 tx=0x7f214c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.443 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.431+0000 7f213e7fc700 1 -- 172.21.15.139:0/471794052 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214c011770 con 0x7f21500a4230 2020-02-12T14:12:44.443 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.431+0000 7f213e7fc700 1 -- 172.21.15.139:0/471794052 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f214c011b90 con 0x7f21500a4230 2020-02-12T14:12:44.443 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.431+0000 7f2157925700 1 -- 172.21.15.139:0/471794052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2150063de0 con 0x7f21500a4230 2020-02-12T14:12:44.443 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.431+0000 7f2157925700 1 -- 172.21.15.139:0/471794052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2150064330 con 0x7f21500a4230 2020-02-12T14:12:44.444 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.431+0000 7f2154ec0700 1 --2- 172.21.15.139:0/471794052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21500a4230 0x7f2150143420 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f21500a5750 tx=0x7f214c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.444 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.432+0000 7f213e7fc700 1 -- 172.21.15.139:0/471794052 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f214c00b0a0 con 0x7f21500a4230 2020-02-12T14:12:44.444 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.432+0000 7f2157925700 1 -- 172.21.15.139:0/471794052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2150135700 con 0x7f21500a4230 2020-02-12T14:12:44.444 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.432+0000 7f2154ec0700 1 --2- 172.21.15.139:0/471794052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21500a4230 0x7f2150143420 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f21500a5750 tx=0x7f214c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.444 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.432+0000 7f213e7fc700 1 --2- 172.21.15.139:0/471794052 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f2130039ab0 0x7f213003bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.444 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.432+0000 7f2154ec0700 1 --2- 172.21.15.139:0/471794052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21500a4230 0x7f2150143420 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f21500a5750 tx=0x7f214c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.444 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.432+0000 7f213e7fc700 1 -- 172.21.15.139:0/471794052 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f214c0497d0 con 0x7f21500a4230 2020-02-12T14:12:44.445 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.432+0000 7f21556c1700 1 --2- 172.21.15.139:0/471794052 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f2130039ab0 0x7f213003bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.445 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.432+0000 7f213e7fc700 1 --2- 172.21.15.139:0/471794052 >> [v2:172.21.15.72:6808/21599,v1:172.21.15.72:6810/21599] conn(0x7f2130040700 0x7f2130042b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.445 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.432+0000 7f213e7fc700 1 -- 172.21.15.139:0/471794052 --> [v2:172.21.15.72:6808/21599,v1:172.21.15.72:6810/21599] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f21300430e0 con 0x7f2130040700 2020-02-12T14:12:44.445 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.432+0000 7f213e7fc700 1 -- 172.21.15.139:0/471794052 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f214c02ecd0 con 0x7f21500a4230 2020-02-12T14:12:44.445 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.432+0000 7f21556c1700 1 --2- 172.21.15.139:0/471794052 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f2130039ab0 0x7f213003bf70 crc :-1 s=READY pgs=64 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.445 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.432+0000 7f2155ec2700 1 --2- 172.21.15.139:0/471794052 >> [v2:172.21.15.72:6808/21599,v1:172.21.15.72:6810/21599] conn(0x7f2130040700 0x7f2130042b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.445 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.432+0000 7f2155ec2700 1 --2- 172.21.15.139:0/471794052 >> [v2:172.21.15.72:6808/21599,v1:172.21.15.72:6810/21599] conn(0x7f2130040700 0x7f2130042b20 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.446 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.433+0000 7f213e7fc700 1 -- 172.21.15.139:0/471794052 <== osd.5 v2:172.21.15.72:6808/21599 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f21300430e0 con 0x7f2130040700 2020-02-12T14:12:44.453 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.450+0000 7f2157925700 1 -- 172.21.15.139:0/471794052 --> [v2:172.21.15.72:6808/21599,v1:172.21.15.72:6810/21599] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2150067e20 con 0x7f2130040700 2020-02-12T14:12:44.454 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.451+0000 7f213e7fc700 1 -- 172.21.15.139:0/471794052 <== osd.5 v2:172.21.15.72:6808/21599 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2150067e20 con 0x7f2130040700 2020-02-12T14:12:44.454 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.452+0000 7f2157925700 1 -- 172.21.15.139:0/471794052 >> [v2:172.21.15.72:6808/21599,v1:172.21.15.72:6810/21599] conn(0x7f2130040700 msgr2=0x7f2130042b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.455 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.452+0000 7f2157925700 1 --2- 172.21.15.139:0/471794052 >> [v2:172.21.15.72:6808/21599,v1:172.21.15.72:6810/21599] conn(0x7f2130040700 0x7f2130042b20 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.455 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.452+0000 7f2157925700 1 -- 172.21.15.139:0/471794052 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f2130039ab0 msgr2=0x7f213003bf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.455 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.452+0000 7f2157925700 1 --2- 172.21.15.139:0/471794052 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f2130039ab0 0x7f213003bf70 crc :-1 s=READY pgs=64 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.455 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.452+0000 7f2157925700 1 -- 172.21.15.139:0/471794052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21500a4230 msgr2=0x7f2150143420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.455 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.452+0000 7f2157925700 1 --2- 172.21.15.139:0/471794052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21500a4230 0x7f2150143420 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f21500a5750 tx=0x7f214c010900).stop 2020-02-12T14:12:44.455 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.452+0000 7f2155ec2700 1 -- 172.21.15.139:0/471794052 reap_dead start 2020-02-12T14:12:44.455 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.452+0000 7f2157925700 1 -- 172.21.15.139:0/471794052 shutdown_connections 2020-02-12T14:12:44.456 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.452+0000 7f2157925700 1 --2- 172.21.15.139:0/471794052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21500a4230 0x7f2150143420 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.456 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.452+0000 7f2157925700 1 -- 172.21.15.139:0/471794052 >> 172.21.15.139:0/471794052 conn(0x7f2150060950 msgr2=0x7f215005e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:44.456 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.452+0000 7f2157925700 1 -- 172.21.15.139:0/471794052 shutdown_connections 2020-02-12T14:12:44.456 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.452+0000 7f2157925700 1 -- 172.21.15.139:0/471794052 wait complete. 2020-02-12T14:12:44.463 INFO:teuthology.orchestra.run.smithi139.stdout:55834574854 2020-02-12T14:12:44.464 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 flush_pg_stats 2020-02-12T14:12:44.570 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.567+0000 7fa976b40700 1 Processor -- start 2020-02-12T14:12:44.570 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.567+0000 7fa976b40700 1 -- start start 2020-02-12T14:12:44.573 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.568+0000 7fa976b40700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa970135500 0x7fa9700a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:44.573 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.568+0000 7fa976b40700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa9700a21f0 0x7fa97012e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:44.573 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.568+0000 7fa976b40700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9701359e0 con 0x7fa9700a3f40 2020-02-12T14:12:44.573 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.568+0000 7fa976b40700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa970135c80 con 0x7fa9700a21f0 2020-02-12T14:12:44.573 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.568+0000 7fa976b40700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9700a18f0 con 0x7fa970135500 2020-02-12T14:12:44.573 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.568+0000 7fa9750dd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa9700a21f0 0x7fa97012e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.573 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.568+0000 7fa96ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa970135500 0x7fa9700a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.574 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.568+0000 7fa9748dc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa9700a3f40 0x7fa970134df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.139:49384/0 (socket says 172.21.15.139:49384) 2020-02-12T14:12:44.574 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.568+0000 7fa9750dd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa9700a21f0 0x7fa97012e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.139:49782/0 (socket says 172.21.15.139:49782) 2020-02-12T14:12:44.574 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.568+0000 7fa9748dc700 1 -- 172.21.15.139:0/375142979 learned_addr learned my addr 172.21.15.139:0/375142979 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:44.574 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.569+0000 7fa9750dd700 1 -- 172.21.15.139:0/375142979 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa970135500 msgr2=0x7fa9700a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:44.574 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.569+0000 7fa9750dd700 1 --2- 172.21.15.139:0/375142979 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa970135500 0x7fa9700a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:44.574 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.569+0000 7fa9750dd700 1 -- 172.21.15.139:0/375142979 >> v1:172.21.15.72:6789/0 conn(0x7fa9700a3f40 legacy=0x7fa970134df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.574 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.569+0000 7fa9750dd700 1 -- 172.21.15.139:0/375142979 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9700a2680 con 0x7fa9700a21f0 2020-02-12T14:12:44.575 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.569+0000 7fa9750dd700 1 --2- 172.21.15.139:0/375142979 >> v2:172.21.15.72:3300/0 conn(0x7fa9700a21f0 0x7fa97012e6b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa9680032b0 tx=0x7fa968008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.575 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.569+0000 7fa9750dd700 1 --2- 172.21.15.139:0/375142979 >> v2:172.21.15.72:3300/0 conn(0x7fa9700a21f0 0x7fa97012e6b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa9680032b0 tx=0x7fa968008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.575 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.569+0000 7fa9750dd700 1 --2- 172.21.15.139:0/375142979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9700a21f0 0x7fa97012e6b0 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7fa9680032b0 tx=0x7fa968008c60).ready entity=mon.0 client_cookie=d8267151a71d25e9 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.575 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.569+0000 7fa9750dd700 1 --2- 172.21.15.139:0/375142979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9700a21f0 0x7fa97012e6b0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fa9680032b0 tx=0x7fa968008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.575 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.569+0000 7fa96f7fe700 1 -- 172.21.15.139:0/375142979 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa968011e60 con 0x7fa9700a21f0 2020-02-12T14:12:44.575 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.569+0000 7fa9750dd700 1 --2- 172.21.15.139:0/375142979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9700a21f0 0x7fa97012e6b0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fa9680032b0 tx=0x7fa968008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.576 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.569+0000 7fa9750dd700 1 --2- 172.21.15.139:0/375142979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9700a21f0 0x7fa97012e6b0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fa9680032b0 tx=0x7fa968008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.576 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.569+0000 7fa96f7fe700 1 -- 172.21.15.139:0/375142979 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96800a160 con 0x7fa9700a21f0 2020-02-12T14:12:44.576 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.569+0000 7fa96f7fe700 1 -- 172.21.15.139:0/375142979 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa96800a500 con 0x7fa9700a21f0 2020-02-12T14:12:44.576 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.569+0000 7fa976b40700 1 -- 172.21.15.139:0/375142979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9700a21f0 msgr2=0x7fa97012e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.576 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.569+0000 7fa976b40700 1 --2- 172.21.15.139:0/375142979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9700a21f0 0x7fa97012e6b0 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7fa9680032b0 tx=0x7fa968008c60).stop 2020-02-12T14:12:44.576 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.570+0000 7fa976b40700 1 -- 172.21.15.139:0/375142979 shutdown_connections 2020-02-12T14:12:44.576 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.570+0000 7fa976b40700 1 --2- 172.21.15.139:0/375142979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9700a21f0 0x7fa97012e6b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.576 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.570+0000 7fa976b40700 1 --2- 172.21.15.139:0/375142979 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa970135500 0x7fa9700a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:44.577 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.570+0000 7fa976b40700 1 -- 172.21.15.139:0/375142979 >> 172.21.15.139:0/375142979 conn(0x7fa970060950 msgr2=0x7fa97009d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:44.577 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.570+0000 7fa976b40700 1 -- 172.21.15.139:0/375142979 shutdown_connections 2020-02-12T14:12:44.577 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.570+0000 7fa976b40700 1 -- 172.21.15.139:0/375142979 wait complete. 2020-02-12T14:12:44.577 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.570+0000 7fa976b40700 1 Processor -- start 2020-02-12T14:12:44.577 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.570+0000 7fa976b40700 1 -- start start 2020-02-12T14:12:44.580 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.571+0000 7fa976b40700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa9700a21f0 0x7fa970138020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.580 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.571+0000 7fa976b40700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa970136a80 con 0x7fa9700a3f40 2020-02-12T14:12:44.580 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.571+0000 7fa976b40700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa970138580 con 0x7fa970135500 2020-02-12T14:12:44.580 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.571+0000 7fa976b40700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa970139040 con 0x7fa9700a21f0 2020-02-12T14:12:44.581 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.571+0000 7fa9748dc700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa9700a21f0 0x7fa970138020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.581 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.571+0000 7fa9750dd700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fa970135500 0x7fa9700a05d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35516/0 (socket says 172.21.15.139:35516) 2020-02-12T14:12:44.581 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.571+0000 7fa9750dd700 1 -- 172.21.15.139:0/11357916 learned_addr learned my addr 172.21.15.139:0/11357916 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:44.581 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.572+0000 7fa9748dc700 1 -- 172.21.15.139:0/11357916 >> v1:172.21.15.139:6789/0 conn(0x7fa970135500 legacy=0x7fa9700a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.581 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.572+0000 7fa9748dc700 1 -- 172.21.15.139:0/11357916 >> v1:172.21.15.72:6789/0 conn(0x7fa9700a3f40 legacy=0x7fa97009eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.581 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.572+0000 7fa96dffb700 1 -- 172.21.15.139:0/11357916 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2347286716 0 0) 0x7fa970138580 con 0x7fa970135500 2020-02-12T14:12:44.581 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.572+0000 7fa9748dc700 1 -- 172.21.15.139:0/11357916 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa970136ce0 con 0x7fa9700a21f0 2020-02-12T14:12:44.581 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.572+0000 7fa9748dc700 1 --2- 172.21.15.139:0/11357916 >> v2:172.21.15.139:3300/0 conn(0x7fa9700a21f0 0x7fa970138020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa970135900 tx=0x7fa960010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.582 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.572+0000 7fa9748dc700 1 --2- 172.21.15.139:0/11357916 >> v2:172.21.15.139:3300/0 conn(0x7fa9700a21f0 0x7fa970138020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa970135900 tx=0x7fa960010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.582 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.572+0000 7fa9748dc700 1 --2- 172.21.15.139:0/11357916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa9700a21f0 0x7fa970138020 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7fa970135900 tx=0x7fa960010970).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.582 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.572+0000 7fa9748dc700 1 --2- 172.21.15.139:0/11357916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa9700a21f0 0x7fa970138020 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7fa970135900 tx=0x7fa960010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.582 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.572+0000 7fa96dffb700 1 -- 172.21.15.139:0/11357916 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa960005ca0 con 0x7fa9700a21f0 2020-02-12T14:12:44.582 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.572+0000 7fa9748dc700 1 --2- 172.21.15.139:0/11357916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa9700a21f0 0x7fa970138020 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7fa970135900 tx=0x7fa960010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.582 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.572+0000 7fa96dffb700 1 -- 172.21.15.139:0/11357916 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa960005e00 con 0x7fa9700a21f0 2020-02-12T14:12:44.582 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.572+0000 7fa9748dc700 1 --2- 172.21.15.139:0/11357916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa9700a21f0 0x7fa970138020 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7fa970135900 tx=0x7fa960010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.583 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.572+0000 7fa976b40700 1 -- 172.21.15.139:0/11357916 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa970135f60 con 0x7fa9700a21f0 2020-02-12T14:12:44.583 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.572+0000 7fa96dffb700 1 -- 172.21.15.139:0/11357916 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9600062b0 con 0x7fa9700a21f0 2020-02-12T14:12:44.583 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.572+0000 7fa976b40700 1 -- 172.21.15.139:0/11357916 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9700a9e60 con 0x7fa9700a21f0 2020-02-12T14:12:44.583 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.572+0000 7fa9748dc700 1 --2- 172.21.15.139:0/11357916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa9700a21f0 0x7fa970138020 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7fa970135900 tx=0x7fa960010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.583 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.573+0000 7fa976b40700 1 -- 172.21.15.139:0/11357916 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa970067e20 con 0x7fa9700a21f0 2020-02-12T14:12:44.583 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.573+0000 7fa96dffb700 1 -- 172.21.15.139:0/11357916 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fa9600064a0 con 0x7fa9700a21f0 2020-02-12T14:12:44.583 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.573+0000 7fa9748dc700 1 --2- 172.21.15.139:0/11357916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa9700a21f0 0x7fa970138020 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7fa970135900 tx=0x7fa960010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.573+0000 7fa9748dc700 1 --2- 172.21.15.139:0/11357916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa9700a21f0 0x7fa970138020 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7fa970135900 tx=0x7fa960010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.573+0000 7fa96dffb700 1 --2- 172.21.15.139:0/11357916 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fa9500399d0 0x7fa95003be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.573+0000 7fa96dffb700 1 -- 172.21.15.139:0/11357916 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fa96004b660 con 0x7fa9700a21f0 2020-02-12T14:12:44.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.573+0000 7fa96ffff700 1 --2- 172.21.15.139:0/11357916 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fa9500399d0 0x7fa95003be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.573+0000 7fa96dffb700 1 --2- 172.21.15.139:0/11357916 >> [v2:172.21.15.72:6809/21601,v1:172.21.15.72:6811/21601] conn(0x7fa950040590 0x7fa9500429b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.573+0000 7fa96dffb700 1 -- 172.21.15.139:0/11357916 --> [v2:172.21.15.72:6809/21601,v1:172.21.15.72:6811/21601] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa950042f70 con 0x7fa950040590 2020-02-12T14:12:44.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.573+0000 7fa96dffb700 1 -- 172.21.15.139:0/11357916 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa96004cb00 con 0x7fa9700a21f0 2020-02-12T14:12:44.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.573+0000 7fa96ffff700 1 --2- 172.21.15.139:0/11357916 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fa9500399d0 0x7fa95003be90 crc :-1 s=READY pgs=65 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.585 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.573+0000 7fa9750dd700 1 --2- 172.21.15.139:0/11357916 >> [v2:172.21.15.72:6809/21601,v1:172.21.15.72:6811/21601] conn(0x7fa950040590 0x7fa9500429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.585 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.574+0000 7fa9750dd700 1 --2- 172.21.15.139:0/11357916 >> [v2:172.21.15.72:6809/21601,v1:172.21.15.72:6811/21601] conn(0x7fa950040590 0x7fa9500429b0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.585 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.574+0000 7fa96dffb700 1 -- 172.21.15.139:0/11357916 <== osd.6 v2:172.21.15.72:6809/21601 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7fa950042f70 con 0x7fa950040590 2020-02-12T14:12:44.594 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.592+0000 7fa976b40700 1 -- 172.21.15.139:0/11357916 --> [v2:172.21.15.72:6809/21601,v1:172.21.15.72:6811/21601] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa9700a0f20 con 0x7fa950040590 2020-02-12T14:12:44.594 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.592+0000 7fa96dffb700 1 -- 172.21.15.139:0/11357916 <== osd.6 v2:172.21.15.72:6809/21601 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa9700a0f20 con 0x7fa950040590 2020-02-12T14:12:44.595 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.593+0000 7fa976b40700 1 -- 172.21.15.139:0/11357916 >> [v2:172.21.15.72:6809/21601,v1:172.21.15.72:6811/21601] conn(0x7fa950040590 msgr2=0x7fa9500429b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.595 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.593+0000 7fa976b40700 1 --2- 172.21.15.139:0/11357916 >> [v2:172.21.15.72:6809/21601,v1:172.21.15.72:6811/21601] conn(0x7fa950040590 0x7fa9500429b0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.596 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.593+0000 7fa976b40700 1 -- 172.21.15.139:0/11357916 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fa9500399d0 msgr2=0x7fa95003be90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.596 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.593+0000 7fa976b40700 1 --2- 172.21.15.139:0/11357916 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fa9500399d0 0x7fa95003be90 crc :-1 s=READY pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.596 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.593+0000 7fa976b40700 1 -- 172.21.15.139:0/11357916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa9700a21f0 msgr2=0x7fa970138020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.596 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.593+0000 7fa976b40700 1 --2- 172.21.15.139:0/11357916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa9700a21f0 0x7fa970138020 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7fa970135900 tx=0x7fa960010970).stop 2020-02-12T14:12:44.596 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.593+0000 7fa9750dd700 1 -- 172.21.15.139:0/11357916 reap_dead start 2020-02-12T14:12:44.596 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.593+0000 7fa976b40700 1 -- 172.21.15.139:0/11357916 shutdown_connections 2020-02-12T14:12:44.596 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.593+0000 7fa976b40700 1 --2- 172.21.15.139:0/11357916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa9700a21f0 0x7fa970138020 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.597 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.593+0000 7fa976b40700 1 -- 172.21.15.139:0/11357916 >> 172.21.15.139:0/11357916 conn(0x7fa970060950 msgr2=0x7fa97005e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:44.597 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.593+0000 7fa976b40700 1 -- 172.21.15.139:0/11357916 shutdown_connections 2020-02-12T14:12:44.597 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.593+0000 7fa976b40700 1 -- 172.21.15.139:0/11357916 wait complete. 2020-02-12T14:12:44.604 INFO:teuthology.orchestra.run.smithi139.stdout:55834574855 2020-02-12T14:12:44.605 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 flush_pg_stats 2020-02-12T14:12:44.711 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.709+0000 7fc91da8f700 1 Processor -- start 2020-02-12T14:12:44.711 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.709+0000 7fc91da8f700 1 -- start start 2020-02-12T14:12:44.714 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.710+0000 7fc91da8f700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc918135500 0x7fc9180a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:44.714 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.710+0000 7fc91da8f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc9180a21f0 0x7fc91812e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:44.714 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.710+0000 7fc91da8f700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9181359e0 con 0x7fc9180a3f40 2020-02-12T14:12:44.715 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.710+0000 7fc91da8f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc918135c80 con 0x7fc9180a21f0 2020-02-12T14:12:44.715 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.710+0000 7fc91da8f700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9180a18f0 con 0x7fc918135500 2020-02-12T14:12:44.715 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.710+0000 7fc916ffd700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc918135500 0x7fc9180a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.715 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.710+0000 7fc9177fe700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fc9180a3f40 0x7fc918134df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35524/0 (socket says 172.21.15.139:35524) 2020-02-12T14:12:44.715 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.710+0000 7fc9177fe700 1 -- 172.21.15.139:0/729997819 learned_addr learned my addr 172.21.15.139:0/729997819 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:44.715 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.710+0000 7fc917fff700 1 --2- 172.21.15.139:0/729997819 >> v2:172.21.15.72:3300/0 conn(0x7fc9180a21f0 0x7fc91812e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.715 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.710+0000 7fc916ffd700 1 -- 172.21.15.139:0/729997819 >> v2:172.21.15.72:3300/0 conn(0x7fc9180a21f0 msgr2=0x7fc91812e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:44.716 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.710+0000 7fc916ffd700 1 --2- 172.21.15.139:0/729997819 >> v2:172.21.15.72:3300/0 conn(0x7fc9180a21f0 0x7fc91812e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:44.716 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.710+0000 7fc916ffd700 1 -- 172.21.15.139:0/729997819 >> v1:172.21.15.139:6789/0 conn(0x7fc9180a3f40 legacy=0x7fc918134df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.716 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.710+0000 7fc9167fc700 1 -- 172.21.15.139:0/729997819 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 284692663 0 0) 0x7fc9181359e0 con 0x7fc9180a3f40 2020-02-12T14:12:44.716 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.710+0000 7fc916ffd700 1 -- 172.21.15.139:0/729997819 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9180a2680 con 0x7fc918135500 2020-02-12T14:12:44.716 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.710+0000 7fc916ffd700 1 --2- 172.21.15.139:0/729997819 >> v2:172.21.15.139:3300/0 conn(0x7fc918135500 0x7fc9180a1d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc908002f30 tx=0x7fc908007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.716 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.710+0000 7fc916ffd700 1 --2- 172.21.15.139:0/729997819 >> v2:172.21.15.139:3300/0 conn(0x7fc918135500 0x7fc9180a1d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc908002f30 tx=0x7fc908007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.716 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.710+0000 7fc916ffd700 1 --2- 172.21.15.139:0/729997819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc918135500 0x7fc9180a1d90 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7fc908002f30 tx=0x7fc908007a40).ready entity=mon.1 client_cookie=b2e666339ce8aa15 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.717 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.710+0000 7fc916ffd700 1 --2- 172.21.15.139:0/729997819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc918135500 0x7fc9180a1d90 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fc908002f30 tx=0x7fc908007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.717 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.710+0000 7fc9167fc700 1 -- 172.21.15.139:0/729997819 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc908011470 con 0x7fc918135500 2020-02-12T14:12:44.717 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.710+0000 7fc916ffd700 1 --2- 172.21.15.139:0/729997819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc918135500 0x7fc9180a1d90 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fc908002f30 tx=0x7fc908007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.717 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.710+0000 7fc9167fc700 1 -- 172.21.15.139:0/729997819 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9080115d0 con 0x7fc918135500 2020-02-12T14:12:44.717 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.710+0000 7fc916ffd700 1 --2- 172.21.15.139:0/729997819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc918135500 0x7fc9180a1d90 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fc908002f30 tx=0x7fc908007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.717 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.710+0000 7fc9167fc700 1 -- 172.21.15.139:0/729997819 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc908011970 con 0x7fc918135500 2020-02-12T14:12:44.717 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.710+0000 7fc91da8f700 1 -- 172.21.15.139:0/729997819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc918135500 msgr2=0x7fc9180a1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.717 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.710+0000 7fc91da8f700 1 --2- 172.21.15.139:0/729997819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc918135500 0x7fc9180a1d90 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7fc908002f30 tx=0x7fc908007a40).stop 2020-02-12T14:12:44.718 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.711+0000 7fc91da8f700 1 -- 172.21.15.139:0/729997819 shutdown_connections 2020-02-12T14:12:44.718 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.711+0000 7fc91da8f700 1 --2- 172.21.15.139:0/729997819 >> v2:172.21.15.72:3300/0 conn(0x7fc9180a21f0 0x7fc91812e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:44.718 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.711+0000 7fc91da8f700 1 --2- 172.21.15.139:0/729997819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc918135500 0x7fc9180a1d90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.718 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.711+0000 7fc91da8f700 1 -- 172.21.15.139:0/729997819 >> 172.21.15.139:0/729997819 conn(0x7fc918060950 msgr2=0x7fc91809d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:44.718 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.711+0000 7fc91da8f700 1 -- 172.21.15.139:0/729997819 shutdown_connections 2020-02-12T14:12:44.718 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.711+0000 7fc91da8f700 1 -- 172.21.15.139:0/729997819 wait complete. 2020-02-12T14:12:44.718 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.712+0000 7fc91da8f700 1 Processor -- start 2020-02-12T14:12:44.719 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.712+0000 7fc91da8f700 1 -- start start 2020-02-12T14:12:44.723 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.712+0000 7fc91da8f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9180a3f40 0x7fc918130580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.723 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc91da8f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9180aa010 con 0x7fc9180a21f0 2020-02-12T14:12:44.724 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc91da8f700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9180a4cf0 con 0x7fc918135500 2020-02-12T14:12:44.724 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc91da8f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc918126040 con 0x7fc9180a3f40 2020-02-12T14:12:44.724 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc917fff700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fc918135500 0x7fc918131c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35534/0 (socket says 172.21.15.139:35534) 2020-02-12T14:12:44.724 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc917fff700 1 -- 172.21.15.139:0/1604679298 learned_addr learned my addr 172.21.15.139:0/1604679298 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:44.724 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc916ffd700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9180a3f40 0x7fc918130580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.724 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc914ff9700 1 -- 172.21.15.139:0/1604679298 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 163333207 0 0) 0x7fc9180a4cf0 con 0x7fc918135500 2020-02-12T14:12:44.724 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc914ff9700 1 -- 172.21.15.139:0/1604679298 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8f8002fe0 con 0x7fc918135500 2020-02-12T14:12:44.724 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc914ff9700 1 -- 172.21.15.139:0/1604679298 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884300194 0 0) 0x7fc9180aa010 con 0x7fc9180a21f0 2020-02-12T14:12:44.725 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc914ff9700 1 -- 172.21.15.139:0/1604679298 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9180a4cf0 con 0x7fc9180a21f0 2020-02-12T14:12:44.725 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc914ff9700 1 -- 172.21.15.139:0/1604679298 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3955870527 0 0) 0x7fc8f8002fe0 con 0x7fc918135500 2020-02-12T14:12:44.725 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc914ff9700 1 -- 172.21.15.139:0/1604679298 --> v1:172.21.15.139:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc9180aa010 con 0x7fc918135500 2020-02-12T14:12:44.725 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc914ff9700 1 -- 172.21.15.139:0/1604679298 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7fc910001960 con 0x7fc918135500 2020-02-12T14:12:44.725 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc914ff9700 1 -- 172.21.15.139:0/1604679298 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9180a3f40 msgr2=0x7fc918130580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.725 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc914ff9700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9180a3f40 0x7fc918130580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.725 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc914ff9700 1 -- 172.21.15.139:0/1604679298 >> v1:172.21.15.139:6789/0 conn(0x7fc918135500 legacy=0x7fc918131c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.726 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc914ff9700 1 -- 172.21.15.139:0/1604679298 >> v1:172.21.15.72:6789/0 conn(0x7fc9180a21f0 legacy=0x7fc91812fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.726 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc914ff9700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8f8004b20 0x7fc8f8004f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.726 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc914ff9700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9180a3f40 0x7fc8f8003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.726 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc914ff9700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8f8003f10 0x7fc8f8004390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.726 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc914ff9700 1 -- 172.21.15.139:0/1604679298 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc918126040 con 0x7fc8f8003f10 2020-02-12T14:12:44.726 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc914ff9700 1 -- 172.21.15.139:0/1604679298 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f80047f0 con 0x7fc8f8004b20 2020-02-12T14:12:44.726 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc914ff9700 1 -- 172.21.15.139:0/1604679298 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f8004980 con 0x7fc9180a3f40 2020-02-12T14:12:44.727 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc9177fe700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8f8004b20 0x7fc8f8004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.727 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc917fff700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8f8003f10 0x7fc8f8004390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.727 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc916ffd700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9180a3f40 0x7fc8f8003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.727 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc9177fe700 1 -- 172.21.15.139:0/1604679298 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9180a3f40 msgr2=0x7fc8f8003ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.727 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc9177fe700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9180a3f40 0x7fc8f8003ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.727 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc9177fe700 1 -- 172.21.15.139:0/1604679298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8f8003f10 msgr2=0x7fc8f8004390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.727 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc9177fe700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8f8003f10 0x7fc8f8004390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.727 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc9177fe700 1 -- 172.21.15.139:0/1604679298 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91812fa10 con 0x7fc8f8004b20 2020-02-12T14:12:44.728 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.713+0000 7fc91da8f700 1 -- 172.21.15.139:0/1604679298 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc918125da0 con 0x7fc8f8004b20 2020-02-12T14:12:44.728 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.714+0000 7fc9177fe700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8f8004b20 0x7fc8f8004f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc90c000ee0 tx=0x7fc90c00c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.728 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.714+0000 7fc91da8f700 1 -- 172.21.15.139:0/1604679298 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9180a85a0 con 0x7fc8f8004b20 2020-02-12T14:12:44.728 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.714+0000 7fc9177fe700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8f8004b20 0x7fc8f8004f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc90c000ee0 tx=0x7fc90c00c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.728 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.714+0000 7fc9177fe700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8f8004b20 0x7fc8f8004f20 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7fc90c000ee0 tx=0x7fc90c00c5f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.728 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.714+0000 7fc9177fe700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8f8004b20 0x7fc8f8004f20 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7fc90c000ee0 tx=0x7fc90c00c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.728 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.714+0000 7fc9177fe700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8f8004b20 0x7fc8f8004f20 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7fc90c000ee0 tx=0x7fc90c00c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.729 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.714+0000 7fc914ff9700 1 -- 172.21.15.139:0/1604679298 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc90c00c950 con 0x7fc8f8004b20 2020-02-12T14:12:44.729 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.714+0000 7fc9177fe700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8f8004b20 0x7fc8f8004f20 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7fc90c000ee0 tx=0x7fc90c00c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.729 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.714+0000 7fc914ff9700 1 -- 172.21.15.139:0/1604679298 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c00cab0 con 0x7fc8f8004b20 2020-02-12T14:12:44.729 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.714+0000 7fc914ff9700 1 -- 172.21.15.139:0/1604679298 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc90c00ce90 con 0x7fc8f8004b20 2020-02-12T14:12:44.729 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.714+0000 7fc9177fe700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8f8004b20 0x7fc8f8004f20 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7fc90c000ee0 tx=0x7fc90c00c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.729 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.714+0000 7fc91da8f700 1 -- 172.21.15.139:0/1604679298 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc8f4003580 con 0x7fc8f8004b20 2020-02-12T14:12:44.729 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.715+0000 7fc914ff9700 1 -- 172.21.15.139:0/1604679298 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fc90c0055c0 con 0x7fc8f8004b20 2020-02-12T14:12:44.730 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.715+0000 7fc9177fe700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8f8004b20 0x7fc8f8004f20 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7fc90c000ee0 tx=0x7fc90c00c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.730 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.715+0000 7fc9177fe700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8f8004b20 0x7fc8f8004f20 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7fc90c000ee0 tx=0x7fc90c00c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.730 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.715+0000 7fc914ff9700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fc8f80421d0 0x7fc8f8044690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.730 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.715+0000 7fc914ff9700 1 -- 172.21.15.139:0/1604679298 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fc90c0492e0 con 0x7fc8f8004b20 2020-02-12T14:12:44.730 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.715+0000 7fc916ffd700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fc8f80421d0 0x7fc8f8044690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.730 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.715+0000 7fc914ff9700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.72:6824/21600,v1:172.21.15.72:6825/21600] conn(0x7fc8f8048c30 0x7fc8f804b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.730 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.715+0000 7fc914ff9700 1 -- 172.21.15.139:0/1604679298 --> [v2:172.21.15.72:6824/21600,v1:172.21.15.72:6825/21600] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc8f804b6a0 con 0x7fc8f8048c30 2020-02-12T14:12:44.730 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.715+0000 7fc914ff9700 1 -- 172.21.15.139:0/1604679298 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc90c04a720 con 0x7fc8f8004b20 2020-02-12T14:12:44.731 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.715+0000 7fc916ffd700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fc8f80421d0 0x7fc8f8044690 crc :-1 s=READY pgs=66 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.731 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.715+0000 7fc917fff700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.72:6824/21600,v1:172.21.15.72:6825/21600] conn(0x7fc8f8048c30 0x7fc8f804b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.731 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.715+0000 7fc917fff700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.72:6824/21600,v1:172.21.15.72:6825/21600] conn(0x7fc8f8048c30 0x7fc8f804b050 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.731 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.716+0000 7fc914ff9700 1 -- 172.21.15.139:0/1604679298 <== osd.7 v2:172.21.15.72:6824/21600 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7fc8f804b6a0 con 0x7fc8f8048c30 2020-02-12T14:12:44.735 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.733+0000 7fc91da8f700 1 -- 172.21.15.139:0/1604679298 --> [v2:172.21.15.72:6824/21600,v1:172.21.15.72:6825/21600] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc8f4002680 con 0x7fc8f8048c30 2020-02-12T14:12:44.736 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.734+0000 7fc914ff9700 1 -- 172.21.15.139:0/1604679298 <== osd.7 v2:172.21.15.72:6824/21600 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc8f4002680 con 0x7fc8f8048c30 2020-02-12T14:12:44.737 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.734+0000 7fc91da8f700 1 -- 172.21.15.139:0/1604679298 >> [v2:172.21.15.72:6824/21600,v1:172.21.15.72:6825/21600] conn(0x7fc8f8048c30 msgr2=0x7fc8f804b050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.737 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.734+0000 7fc91da8f700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.72:6824/21600,v1:172.21.15.72:6825/21600] conn(0x7fc8f8048c30 0x7fc8f804b050 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.737 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.734+0000 7fc917fff700 1 -- 172.21.15.139:0/1604679298 reap_dead start 2020-02-12T14:12:44.737 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.734+0000 7fc91da8f700 1 -- 172.21.15.139:0/1604679298 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fc8f80421d0 msgr2=0x7fc8f8044690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.737 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.734+0000 7fc91da8f700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fc8f80421d0 0x7fc8f8044690 crc :-1 s=READY pgs=66 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.737 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.734+0000 7fc91da8f700 1 -- 172.21.15.139:0/1604679298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8f8004b20 msgr2=0x7fc8f8004f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.738 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.734+0000 7fc91da8f700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8f8004b20 0x7fc8f8004f20 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7fc90c000ee0 tx=0x7fc90c00c5f0).stop 2020-02-12T14:12:44.738 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.734+0000 7fc91da8f700 1 -- 172.21.15.139:0/1604679298 shutdown_connections 2020-02-12T14:12:44.738 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.734+0000 7fc91da8f700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8f8004b20 0x7fc8f8004f20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.738 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.734+0000 7fc91da8f700 1 --2- 172.21.15.139:0/1604679298 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fc8f80421d0 0x7fc8f8044690 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.738 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.734+0000 7fc91da8f700 1 -- 172.21.15.139:0/1604679298 >> 172.21.15.139:0/1604679298 conn(0x7fc918060950 msgr2=0x7fc91805e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:44.738 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.734+0000 7fc91da8f700 1 -- 172.21.15.139:0/1604679298 shutdown_connections 2020-02-12T14:12:44.738 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.734+0000 7fc91da8f700 1 -- 172.21.15.139:0/1604679298 wait complete. 2020-02-12T14:12:44.746 INFO:teuthology.orchestra.run.smithi139.stdout:55834574853 2020-02-12T14:12:44.746 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-02-12T14:12:44.853 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.851+0000 7f8ab9295700 1 Processor -- start 2020-02-12T14:12:44.854 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.851+0000 7f8ab9295700 1 -- start start 2020-02-12T14:12:44.856 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.852+0000 7f8ab9295700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ab40a3f40 0x7f8ab4134df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:44.857 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.852+0000 7f8ab9295700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8ab4135250 0x7f8ab40a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:44.857 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.852+0000 7f8ab9295700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ab40a21f0 0x7f8ab4138340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:44.857 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.852+0000 7f8ab9295700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab41359e0 con 0x7f8ab40a3f40 2020-02-12T14:12:44.857 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.852+0000 7f8ab9295700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab4135c80 con 0x7f8ab4135250 2020-02-12T14:12:44.857 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.852+0000 7f8ab9295700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab40a18f0 con 0x7f8ab40a21f0 2020-02-12T14:12:44.857 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.852+0000 7f8ab27fc700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8ab4135250 0x7f8ab40a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.858 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.852+0000 7f8ab27fc700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8ab4135250 0x7f8ab40a1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46908/0 (socket says 172.21.15.139:46908) 2020-02-12T14:12:44.858 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.852+0000 7f8ab27fc700 1 -- 172.21.15.139:0/367012084 learned_addr learned my addr 172.21.15.139:0/367012084 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:44.858 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.852+0000 7f8ab2ffd700 1 --2- 172.21.15.139:0/367012084 >> v2:172.21.15.72:3300/0 conn(0x7f8ab40a3f40 0x7f8ab4134df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.858 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.852+0000 7f8ab37fe700 1 --2- 172.21.15.139:0/367012084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ab40a21f0 0x7f8ab4138340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.858 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.852+0000 7f8ab27fc700 1 -- 172.21.15.139:0/367012084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ab40a21f0 msgr2=0x7f8ab4138340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:44.858 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.852+0000 7f8ab27fc700 1 --2- 172.21.15.139:0/367012084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ab40a21f0 0x7f8ab4138340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:44.858 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.852+0000 7f8ab27fc700 1 -- 172.21.15.139:0/367012084 >> v2:172.21.15.72:3300/0 conn(0x7f8ab40a3f40 msgr2=0x7f8ab4134df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:44.859 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.852+0000 7f8ab27fc700 1 --2- 172.21.15.139:0/367012084 >> v2:172.21.15.72:3300/0 conn(0x7f8ab40a3f40 0x7f8ab4134df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:44.859 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.852+0000 7f8ab27fc700 1 -- 172.21.15.139:0/367012084 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab41356e0 con 0x7f8ab4135250 2020-02-12T14:12:44.859 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.852+0000 7f8ab2ffd700 1 --2- 172.21.15.139:0/367012084 >> v2:172.21.15.72:3300/0 conn(0x7f8ab40a3f40 0x7f8ab4134df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-12T14:12:44.859 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.852+0000 7f8ab27fc700 1 --2- 172.21.15.139:0/367012084 >> v2:172.21.15.139:3300/0 conn(0x7f8ab4135250 0x7f8ab40a1d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8aa4002f30 tx=0x7f8aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.859 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.852+0000 7f8ab27fc700 1 --2- 172.21.15.139:0/367012084 >> v2:172.21.15.139:3300/0 conn(0x7f8ab4135250 0x7f8ab40a1d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8aa4002f30 tx=0x7f8aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.859 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.852+0000 7f8ab27fc700 1 --2- 172.21.15.139:0/367012084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ab4135250 0x7f8ab40a1d90 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7f8aa4002f30 tx=0x7f8aa4007a40).ready entity=mon.1 client_cookie=7a6187d7c8b69237 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.859 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.853+0000 7f8ab27fc700 1 --2- 172.21.15.139:0/367012084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ab4135250 0x7f8ab40a1d90 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f8aa4002f30 tx=0x7f8aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.860 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.853+0000 7f8ab1ffb700 1 -- 172.21.15.139:0/367012084 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8aa4011720 con 0x7f8ab4135250 2020-02-12T14:12:44.860 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.853+0000 7f8ab27fc700 1 --2- 172.21.15.139:0/367012084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ab4135250 0x7f8ab40a1d90 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f8aa4002f30 tx=0x7f8aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.860 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.853+0000 7f8ab27fc700 1 --2- 172.21.15.139:0/367012084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ab4135250 0x7f8ab40a1d90 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f8aa4002f30 tx=0x7f8aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.860 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.853+0000 7f8ab1ffb700 1 -- 172.21.15.139:0/367012084 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa4011880 con 0x7f8ab4135250 2020-02-12T14:12:44.860 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.853+0000 7f8ab1ffb700 1 -- 172.21.15.139:0/367012084 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8aa4011c20 con 0x7f8ab4135250 2020-02-12T14:12:44.860 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.853+0000 7f8ab9295700 1 -- 172.21.15.139:0/367012084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ab4135250 msgr2=0x7f8ab40a1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.860 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.853+0000 7f8ab9295700 1 --2- 172.21.15.139:0/367012084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ab4135250 0x7f8ab40a1d90 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7f8aa4002f30 tx=0x7f8aa4007a40).stop 2020-02-12T14:12:44.861 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.853+0000 7f8ab9295700 1 -- 172.21.15.139:0/367012084 shutdown_connections 2020-02-12T14:12:44.861 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.853+0000 7f8ab9295700 1 --2- 172.21.15.139:0/367012084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ab40a21f0 0x7f8ab4138340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:44.861 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.853+0000 7f8ab9295700 1 --2- 172.21.15.139:0/367012084 >> v2:172.21.15.72:3300/0 conn(0x7f8ab40a3f40 0x7f8ab4134df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:44.861 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.853+0000 7f8ab9295700 1 --2- 172.21.15.139:0/367012084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ab4135250 0x7f8ab40a1d90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.861 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.853+0000 7f8ab9295700 1 -- 172.21.15.139:0/367012084 >> 172.21.15.139:0/367012084 conn(0x7f8ab4060950 msgr2=0x7f8ab409d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:44.861 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.853+0000 7f8ab9295700 1 -- 172.21.15.139:0/367012084 shutdown_connections 2020-02-12T14:12:44.861 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.853+0000 7f8ab9295700 1 -- 172.21.15.139:0/367012084 wait complete. 2020-02-12T14:12:44.862 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.854+0000 7f8ab9295700 1 Processor -- start 2020-02-12T14:12:44.862 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.854+0000 7f8ab9295700 1 -- start start 2020-02-12T14:12:44.865 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.855+0000 7f8ab9295700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ab4135250 0x7f8ab412b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.865 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.855+0000 7f8ab9295700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab40a4b50 con 0x7f8ab40a21f0 2020-02-12T14:12:44.865 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.855+0000 7f8ab9295700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab4138730 con 0x7f8ab40a3f40 2020-02-12T14:12:44.865 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.855+0000 7f8ab9295700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab4138a30 con 0x7f8ab4135250 2020-02-12T14:12:44.865 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.855+0000 7f8ab27fc700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f8ab40a3f40 0x7f8ab412b1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35554/0 (socket says 172.21.15.139:35554) 2020-02-12T14:12:44.865 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.855+0000 7f8ab27fc700 1 -- 172.21.15.139:0/386209266 learned_addr learned my addr 172.21.15.139:0/386209266 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:44.866 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.855+0000 7f8ab37fe700 1 --2- 172.21.15.139:0/386209266 >> v2:172.21.15.72:3300/0 conn(0x7f8ab4135250 0x7f8ab412b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.866 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.855+0000 7f8aa3fff700 1 -- 172.21.15.139:0/386209266 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4207689814 0 0) 0x7f8ab4138730 con 0x7f8ab40a3f40 2020-02-12T14:12:44.866 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.855+0000 7f8aa3fff700 1 -- 172.21.15.139:0/386209266 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a90002fe0 con 0x7f8ab40a3f40 2020-02-12T14:12:44.866 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.855+0000 7f8aa3fff700 1 -- 172.21.15.139:0/386209266 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172167422 0 0) 0x7f8ab40a4b50 con 0x7f8ab40a21f0 2020-02-12T14:12:44.866 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.855+0000 7f8aa3fff700 1 -- 172.21.15.139:0/386209266 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ab4138730 con 0x7f8ab40a21f0 2020-02-12T14:12:44.866 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.855+0000 7f8aa3fff700 1 -- 172.21.15.139:0/386209266 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3619938561 0 0) 0x7f8a90002fe0 con 0x7f8ab40a3f40 2020-02-12T14:12:44.866 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.855+0000 7f8ab37fe700 1 -- 172.21.15.139:0/386209266 >> v1:172.21.15.139:6789/0 conn(0x7f8ab40a3f40 legacy=0x7f8ab412b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.866 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.855+0000 7f8ab37fe700 1 -- 172.21.15.139:0/386209266 >> v1:172.21.15.72:6789/0 conn(0x7f8ab40a21f0 legacy=0x7f8ab4130c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.867 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.855+0000 7f8ab37fe700 1 -- 172.21.15.139:0/386209266 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab40a0da0 con 0x7f8ab4135250 2020-02-12T14:12:44.867 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.855+0000 7f8ab37fe700 1 --2- 172.21.15.139:0/386209266 >> v2:172.21.15.72:3300/0 conn(0x7f8ab4135250 0x7f8ab412b900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8ab4131dc0 tx=0x7f8aac010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.867 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.855+0000 7f8ab37fe700 1 --2- 172.21.15.139:0/386209266 >> v2:172.21.15.72:3300/0 conn(0x7f8ab4135250 0x7f8ab412b900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8ab4131dc0 tx=0x7f8aac010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.867 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.855+0000 7f8ab37fe700 1 --2- 172.21.15.139:0/386209266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ab4135250 0x7f8ab412b900 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f8ab4131dc0 tx=0x7f8aac010c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.867 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.855+0000 7f8ab37fe700 1 --2- 172.21.15.139:0/386209266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ab4135250 0x7f8ab412b900 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f8ab4131dc0 tx=0x7f8aac010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.867 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.856+0000 7f8aa3fff700 1 -- 172.21.15.139:0/386209266 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8aa40085c0 con 0x7f8ab4135250 2020-02-12T14:12:44.867 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.856+0000 7f8ab37fe700 1 --2- 172.21.15.139:0/386209266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ab4135250 0x7f8ab412b900 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f8ab4131dc0 tx=0x7f8aac010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.856+0000 7f8aa3fff700 1 -- 172.21.15.139:0/386209266 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aac013060 con 0x7f8ab4135250 2020-02-12T14:12:44.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.856+0000 7f8ab37fe700 1 --2- 172.21.15.139:0/386209266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ab4135250 0x7f8ab412b900 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f8ab4131dc0 tx=0x7f8aac010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.856+0000 7f8ab9295700 1 -- 172.21.15.139:0/386209266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab4131380 con 0x7f8ab4135250 2020-02-12T14:12:44.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.856+0000 7f8aa3fff700 1 -- 172.21.15.139:0/386209266 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8aac005e20 con 0x7f8ab4135250 2020-02-12T14:12:44.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.856+0000 7f8ab9295700 1 -- 172.21.15.139:0/386209266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab4130970 con 0x7f8ab4135250 2020-02-12T14:12:44.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.856+0000 7f8ab37fe700 1 --2- 172.21.15.139:0/386209266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ab4135250 0x7f8ab412b900 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f8ab4131dc0 tx=0x7f8aac010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.856+0000 7f8aa3fff700 1 -- 172.21.15.139:0/386209266 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f8aac012530 con 0x7f8ab4135250 2020-02-12T14:12:44.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.856+0000 7f8ab37fe700 1 --2- 172.21.15.139:0/386209266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ab4135250 0x7f8ab412b900 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f8ab4131dc0 tx=0x7f8aac010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.857+0000 7f8ab9295700 1 -- 172.21.15.139:0/386209266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab4136120 con 0x7f8ab4135250 2020-02-12T14:12:44.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.857+0000 7f8aa3fff700 1 --2- 172.21.15.139:0/386209266 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f8a9003a010 0x7f8a9003c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:44.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.857+0000 7f8aa3fff700 1 -- 172.21.15.139:0/386209266 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f8aac049870 con 0x7f8ab4135250 2020-02-12T14:12:44.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.857+0000 7f8ab2ffd700 1 --2- 172.21.15.139:0/386209266 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f8a9003a010 0x7f8a9003c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:44.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.857+0000 7f8ab2ffd700 1 --2- 172.21.15.139:0/386209266 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f8a9003a010 0x7f8a9003c4d0 crc :-1 s=READY pgs=67 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:44.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.860+0000 7f8ab37fe700 1 --2- 172.21.15.139:0/386209266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ab4135250 0x7f8ab412b900 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f8ab4131dc0 tx=0x7f8aac010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.860+0000 7f8aa3fff700 1 -- 172.21.15.139:0/386209266 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f8aac02ee20 con 0x7f8ab4135250 2020-02-12T14:12:44.997 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.995+0000 7f8ab9295700 1 -- 172.21.15.139:0/386209266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8ab40a0f30 con 0x7f8ab4135250 2020-02-12T14:12:44.997 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.995+0000 7f8ab37fe700 1 --2- 172.21.15.139:0/386209266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ab4135250 0x7f8ab412b900 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f8ab4131dc0 tx=0x7f8aac010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:44.998 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.995+0000 7f8aa3fff700 1 -- 172.21.15.139:0/386209266 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8aac031930 con 0x7f8ab4135250 2020-02-12T14:12:44.998 INFO:teuthology.orchestra.run.smithi139.stdout:55834574854 2020-02-12T14:12:44.999 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.996+0000 7f8ab9295700 1 -- 172.21.15.139:0/386209266 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f8a9003a010 msgr2=0x7f8a9003c4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.999 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.996+0000 7f8ab9295700 1 --2- 172.21.15.139:0/386209266 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f8a9003a010 0x7f8a9003c4d0 crc :-1 s=READY pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:44.999 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.996+0000 7f8ab9295700 1 -- 172.21.15.139:0/386209266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ab4135250 msgr2=0x7f8ab412b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:44.999 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.996+0000 7f8ab9295700 1 --2- 172.21.15.139:0/386209266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ab4135250 0x7f8ab412b900 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f8ab4131dc0 tx=0x7f8aac010c10).stop 2020-02-12T14:12:44.999 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.996+0000 7f8ab9295700 1 -- 172.21.15.139:0/386209266 shutdown_connections 2020-02-12T14:12:44.999 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.996+0000 7f8ab9295700 1 --2- 172.21.15.139:0/386209266 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f8a9003a010 0x7f8a9003c4d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:45.000 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.996+0000 7f8ab9295700 1 --2- 172.21.15.139:0/386209266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ab4135250 0x7f8ab412b900 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:45.000 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.996+0000 7f8ab9295700 1 -- 172.21.15.139:0/386209266 >> 172.21.15.139:0/386209266 conn(0x7f8ab4060950 msgr2=0x7f8ab40aab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:45.000 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.996+0000 7f8ab9295700 1 -- 172.21.15.139:0/386209266 shutdown_connections 2020-02-12T14:12:45.000 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:44.996+0000 7f8ab9295700 1 -- 172.21.15.139:0/386209266 wait complete. 2020-02-12T14:12:45.009 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2020-02-12T14:12:46.010 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-02-12T14:12:46.128 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.126+0000 7f4a4103f700 1 Processor -- start 2020-02-12T14:12:46.128 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.126+0000 7f4a4103f700 1 -- start start 2020-02-12T14:12:46.131 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.126+0000 7f4a4103f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a3c0a3f40 0x7f4a3c134df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:46.131 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.126+0000 7f4a4103f700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4a3c135250 0x7f4a3c0a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:46.131 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.126+0000 7f4a4103f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4a3c0a21f0 0x7f4a3c138340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:46.131 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.126+0000 7f4a4103f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a3c1359e0 con 0x7f4a3c0a21f0 2020-02-12T14:12:46.132 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.126+0000 7f4a4103f700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a3c135c80 con 0x7f4a3c135250 2020-02-12T14:12:46.132 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.126+0000 7f4a4103f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c0a18f0 con 0x7f4a3c0a3f40 2020-02-12T14:12:46.132 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.127+0000 7f4a3a59c700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4a3c135250 0x7f4a3c0a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:46.132 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.127+0000 7f4a3a59c700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4a3c135250 0x7f4a3c0a1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46922/0 (socket says 172.21.15.139:46922) 2020-02-12T14:12:46.132 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.127+0000 7f4a3a59c700 1 -- 172.21.15.139:0/1257206993 learned_addr learned my addr 172.21.15.139:0/1257206993 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:46.132 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.127+0000 7f4a3b59e700 1 --2- 172.21.15.139:0/1257206993 >> v2:172.21.15.72:3300/0 conn(0x7f4a3c0a21f0 0x7f4a3c138340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:46.132 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.127+0000 7f4a3ad9d700 1 --2- 172.21.15.139:0/1257206993 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a3c0a3f40 0x7f4a3c134df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:46.132 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.127+0000 7f4a3a59c700 1 -- 172.21.15.139:0/1257206993 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a3c0a3f40 msgr2=0x7f4a3c134df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:46.133 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.127+0000 7f4a3a59c700 1 --2- 172.21.15.139:0/1257206993 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a3c0a3f40 0x7f4a3c134df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:46.133 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.127+0000 7f4a3a59c700 1 -- 172.21.15.139:0/1257206993 >> v2:172.21.15.72:3300/0 conn(0x7f4a3c0a21f0 msgr2=0x7f4a3c138340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:46.133 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.127+0000 7f4a3a59c700 1 --2- 172.21.15.139:0/1257206993 >> v2:172.21.15.72:3300/0 conn(0x7f4a3c0a21f0 0x7f4a3c138340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:46.133 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.127+0000 7f4a3a59c700 1 -- 172.21.15.139:0/1257206993 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3c1356b0 con 0x7f4a3c135250 2020-02-12T14:12:46.133 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.127+0000 7f4a3b59e700 1 --2- 172.21.15.139:0/1257206993 >> v2:172.21.15.72:3300/0 conn(0x7f4a3c0a21f0 0x7f4a3c138340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T14:12:46.133 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.127+0000 7f4a3a59c700 1 --2- 172.21.15.139:0/1257206993 >> v2:172.21.15.139:3300/0 conn(0x7f4a3c135250 0x7f4a3c0a1d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4a300032b0 tx=0x7f4a30007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.133 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.127+0000 7f4a3a59c700 1 --2- 172.21.15.139:0/1257206993 >> v2:172.21.15.139:3300/0 conn(0x7f4a3c135250 0x7f4a3c0a1d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4a300032b0 tx=0x7f4a30007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.134 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.127+0000 7f4a3a59c700 1 --2- 172.21.15.139:0/1257206993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a3c135250 0x7f4a3c0a1d90 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f4a300032b0 tx=0x7f4a30007dc0).ready entity=mon.1 client_cookie=cf5f2303206e0d11 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:46.134 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.127+0000 7f4a3a59c700 1 --2- 172.21.15.139:0/1257206993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a3c135250 0x7f4a3c0a1d90 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f4a300032b0 tx=0x7f4a30007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.134 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.127+0000 7f4a3a59c700 1 --2- 172.21.15.139:0/1257206993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a3c135250 0x7f4a3c0a1d90 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f4a300032b0 tx=0x7f4a30007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.134 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.127+0000 7f4a39d9b700 1 -- 172.21.15.139:0/1257206993 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a3000a160 con 0x7f4a3c135250 2020-02-12T14:12:46.134 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.127+0000 7f4a3a59c700 1 --2- 172.21.15.139:0/1257206993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a3c135250 0x7f4a3c0a1d90 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f4a300032b0 tx=0x7f4a30007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.134 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.127+0000 7f4a39d9b700 1 -- 172.21.15.139:0/1257206993 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3000a2c0 con 0x7f4a3c135250 2020-02-12T14:12:46.134 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.127+0000 7f4a39d9b700 1 -- 172.21.15.139:0/1257206993 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a3000a660 con 0x7f4a3c135250 2020-02-12T14:12:46.135 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.127+0000 7f4a4103f700 1 -- 172.21.15.139:0/1257206993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a3c135250 msgr2=0x7f4a3c0a1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:46.135 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.127+0000 7f4a4103f700 1 --2- 172.21.15.139:0/1257206993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a3c135250 0x7f4a3c0a1d90 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f4a300032b0 tx=0x7f4a30007dc0).stop 2020-02-12T14:12:46.135 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.128+0000 7f4a4103f700 1 -- 172.21.15.139:0/1257206993 shutdown_connections 2020-02-12T14:12:46.135 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.128+0000 7f4a4103f700 1 --2- 172.21.15.139:0/1257206993 >> v2:172.21.15.72:3300/0 conn(0x7f4a3c0a21f0 0x7f4a3c138340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:46.135 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.128+0000 7f4a4103f700 1 --2- 172.21.15.139:0/1257206993 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a3c0a3f40 0x7f4a3c134df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:46.135 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.128+0000 7f4a4103f700 1 --2- 172.21.15.139:0/1257206993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a3c135250 0x7f4a3c0a1d90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:46.135 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.128+0000 7f4a4103f700 1 -- 172.21.15.139:0/1257206993 >> 172.21.15.139:0/1257206993 conn(0x7f4a3c060950 msgr2=0x7f4a3c09d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:46.135 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.128+0000 7f4a4103f700 1 -- 172.21.15.139:0/1257206993 shutdown_connections 2020-02-12T14:12:46.136 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.128+0000 7f4a4103f700 1 -- 172.21.15.139:0/1257206993 wait complete. 2020-02-12T14:12:46.136 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.129+0000 7f4a4103f700 1 Processor -- start 2020-02-12T14:12:46.136 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.129+0000 7f4a4103f700 1 -- start start 2020-02-12T14:12:46.139 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.129+0000 7f4a4103f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a3c0a3f40 0x7f4a3c09f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:46.139 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.129+0000 7f4a4103f700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4a3c135250 0x7f4a3c09fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:46.139 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.129+0000 7f4a4103f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a3c12f7b0 con 0x7f4a3c0a21f0 2020-02-12T14:12:46.139 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.129+0000 7f4a4103f700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a3c09f310 con 0x7f4a3c135250 2020-02-12T14:12:46.139 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.129+0000 7f4a4103f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c138d80 con 0x7f4a3c0a3f40 2020-02-12T14:12:46.139 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.129+0000 7f4a3b59e700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4a3c135250 0x7f4a3c09fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:46.139 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.129+0000 7f4a3b59e700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4a3c135250 0x7f4a3c09fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46928/0 (socket says 172.21.15.139:46928) 2020-02-12T14:12:46.140 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.129+0000 7f4a3b59e700 1 -- 172.21.15.139:0/1454993300 learned_addr learned my addr 172.21.15.139:0/1454993300 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:46.140 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.130+0000 7f4a3a59c700 1 --2- 172.21.15.139:0/1454993300 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a3c0a3f40 0x7f4a3c09f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:46.140 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.130+0000 7f4a3b59e700 1 -- 172.21.15.139:0/1454993300 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a3c0a3f40 msgr2=0x7f4a3c09f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:46.140 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.130+0000 7f4a3b59e700 1 --2- 172.21.15.139:0/1454993300 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a3c0a3f40 0x7f4a3c09f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:46.140 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.130+0000 7f4a2bfff700 1 -- 172.21.15.139:0/1454993300 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416381709 0 0) 0x7f4a3c12f7b0 con 0x7f4a3c0a21f0 2020-02-12T14:12:46.140 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.130+0000 7f4a3b59e700 1 -- 172.21.15.139:0/1454993300 >> v1:172.21.15.72:6789/0 conn(0x7f4a3c0a21f0 legacy=0x7f4a3c12fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:46.140 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.130+0000 7f4a3b59e700 1 -- 172.21.15.139:0/1454993300 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3c132700 con 0x7f4a3c135250 2020-02-12T14:12:46.140 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.130+0000 7f4a3b59e700 1 --2- 172.21.15.139:0/1454993300 >> v2:172.21.15.139:3300/0 conn(0x7f4a3c135250 0x7f4a3c09fad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4a3c09ec40 tx=0x7f4a2c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.141 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.130+0000 7f4a3b59e700 1 --2- 172.21.15.139:0/1454993300 >> v2:172.21.15.139:3300/0 conn(0x7f4a3c135250 0x7f4a3c09fad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4a3c09ec40 tx=0x7f4a2c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.141 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.130+0000 7f4a3b59e700 1 --2- 172.21.15.139:0/1454993300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a3c135250 0x7f4a3c09fad0 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7f4a3c09ec40 tx=0x7f4a2c010ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:46.141 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.130+0000 7f4a3b59e700 1 --2- 172.21.15.139:0/1454993300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a3c135250 0x7f4a3c09fad0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f4a3c09ec40 tx=0x7f4a2c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.141 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.130+0000 7f4a2bfff700 1 -- 172.21.15.139:0/1454993300 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a2c005e90 con 0x7f4a3c135250 2020-02-12T14:12:46.141 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.130+0000 7f4a3b59e700 1 --2- 172.21.15.139:0/1454993300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a3c135250 0x7f4a3c09fad0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f4a3c09ec40 tx=0x7f4a2c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.141 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.130+0000 7f4a3b59e700 1 --2- 172.21.15.139:0/1454993300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a3c135250 0x7f4a3c09fad0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f4a3c09ec40 tx=0x7f4a2c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.141 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.130+0000 7f4a2bfff700 1 -- 172.21.15.139:0/1454993300 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2c007160 con 0x7f4a3c135250 2020-02-12T14:12:46.142 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.130+0000 7f4a4103f700 1 -- 172.21.15.139:0/1454993300 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a3c1381a0 con 0x7f4a3c135250 2020-02-12T14:12:46.142 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.130+0000 7f4a2bfff700 1 -- 172.21.15.139:0/1454993300 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a2c007500 con 0x7f4a3c135250 2020-02-12T14:12:46.142 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.130+0000 7f4a4103f700 1 -- 172.21.15.139:0/1454993300 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a3c137b50 con 0x7f4a3c135250 2020-02-12T14:12:46.142 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.131+0000 7f4a3b59e700 1 --2- 172.21.15.139:0/1454993300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a3c135250 0x7f4a3c09fad0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f4a3c09ec40 tx=0x7f4a2c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.142 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.131+0000 7f4a2bfff700 1 -- 172.21.15.139:0/1454993300 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f4a2c00e170 con 0x7f4a3c135250 2020-02-12T14:12:46.142 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.131+0000 7f4a3b59e700 1 --2- 172.21.15.139:0/1454993300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a3c135250 0x7f4a3c09fad0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f4a3c09ec40 tx=0x7f4a2c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.142 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.131+0000 7f4a4103f700 1 -- 172.21.15.139:0/1454993300 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a3c138ef0 con 0x7f4a3c135250 2020-02-12T14:12:46.143 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.131+0000 7f4a2bfff700 1 --2- 172.21.15.139:0/1454993300 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f4a18039b40 0x7f4a1803c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:46.143 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.131+0000 7f4a2bfff700 1 -- 172.21.15.139:0/1454993300 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f4a2c007e40 con 0x7f4a3c135250 2020-02-12T14:12:46.143 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.131+0000 7f4a3ad9d700 1 --2- 172.21.15.139:0/1454993300 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f4a18039b40 0x7f4a1803c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:46.143 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.131+0000 7f4a3ad9d700 1 --2- 172.21.15.139:0/1454993300 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f4a18039b40 0x7f4a1803c000 crc :-1 s=READY pgs=68 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:46.143 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.135+0000 7f4a3b59e700 1 --2- 172.21.15.139:0/1454993300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a3c135250 0x7f4a3c09fad0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f4a3c09ec40 tx=0x7f4a2c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.143 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.135+0000 7f4a2bfff700 1 -- 172.21.15.139:0/1454993300 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f4a3c138ef0 con 0x7f4a3c135250 2020-02-12T14:12:46.272 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.269+0000 7f4a4103f700 1 -- 172.21.15.139:0/1454993300 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4a3c138ef0 con 0x7f4a3c135250 2020-02-12T14:12:46.272 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.270+0000 7f4a3b59e700 1 --2- 172.21.15.139:0/1454993300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a3c135250 0x7f4a3c09fad0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f4a3c09ec40 tx=0x7f4a2c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.272 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.270+0000 7f4a2bfff700 1 -- 172.21.15.139:0/1454993300 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4a3c138ef0 con 0x7f4a3c135250 2020-02-12T14:12:46.272 INFO:teuthology.orchestra.run.smithi139.stdout:55834574855 2020-02-12T14:12:46.273 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.271+0000 7f4a4103f700 1 -- 172.21.15.139:0/1454993300 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f4a18039b40 msgr2=0x7f4a1803c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:46.273 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.271+0000 7f4a4103f700 1 --2- 172.21.15.139:0/1454993300 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f4a18039b40 0x7f4a1803c000 crc :-1 s=READY pgs=68 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:46.273 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.271+0000 7f4a4103f700 1 -- 172.21.15.139:0/1454993300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a3c135250 msgr2=0x7f4a3c09fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:46.274 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.271+0000 7f4a4103f700 1 --2- 172.21.15.139:0/1454993300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a3c135250 0x7f4a3c09fad0 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7f4a3c09ec40 tx=0x7f4a2c010ac0).stop 2020-02-12T14:12:46.274 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.271+0000 7f4a4103f700 1 -- 172.21.15.139:0/1454993300 shutdown_connections 2020-02-12T14:12:46.274 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.271+0000 7f4a4103f700 1 --2- 172.21.15.139:0/1454993300 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f4a18039b40 0x7f4a1803c000 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:46.274 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.271+0000 7f4a4103f700 1 --2- 172.21.15.139:0/1454993300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a3c135250 0x7f4a3c09fad0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:46.274 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.271+0000 7f4a4103f700 1 --2- 172.21.15.139:0/1454993300 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a3c0a3f40 0x7f4a3c09f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:46.274 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.271+0000 7f4a4103f700 1 -- 172.21.15.139:0/1454993300 >> 172.21.15.139:0/1454993300 conn(0x7f4a3c060950 msgr2=0x7f4a3c05e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:46.274 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.271+0000 7f4a4103f700 1 -- 172.21.15.139:0/1454993300 shutdown_connections 2020-02-12T14:12:46.275 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.271+0000 7f4a4103f700 1 -- 172.21.15.139:0/1454993300 wait complete. 2020-02-12T14:12:46.283 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2020-02-12T14:12:46.283 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2020-02-12T14:12:46.390 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.387+0000 7fd61c4cb700 1 Processor -- start 2020-02-12T14:12:46.390 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.387+0000 7fd61c4cb700 1 -- start start 2020-02-12T14:12:46.395 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.388+0000 7fd61c4cb700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd614135500 0x7fd6140a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:46.395 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.388+0000 7fd61c4cb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6140a21f0 0x7fd61412e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:46.396 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.388+0000 7fd61c4cb700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6141359e0 con 0x7fd6140a3f40 2020-02-12T14:12:46.396 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.388+0000 7fd61c4cb700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd614135c80 con 0x7fd614135500 2020-02-12T14:12:46.396 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.388+0000 7fd61c4cb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6140a18f0 con 0x7fd6140a21f0 2020-02-12T14:12:46.396 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.388+0000 7fd619a66700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd614135500 0x7fd6140a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:46.396 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.388+0000 7fd619a66700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd614135500 0x7fd6140a1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46932/0 (socket says 172.21.15.139:46932) 2020-02-12T14:12:46.396 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.388+0000 7fd61a267700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fd6140a3f40 0x7fd614134df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35570/0 (socket says 172.21.15.139:35570) 2020-02-12T14:12:46.396 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.388+0000 7fd619a66700 1 -- 172.21.15.139:0/2554199769 learned_addr learned my addr 172.21.15.139:0/2554199769 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:46.397 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.388+0000 7fd61aa68700 1 --2- 172.21.15.139:0/2554199769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6140a21f0 0x7fd61412e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:46.397 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.389+0000 7fd619a66700 1 -- 172.21.15.139:0/2554199769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6140a21f0 msgr2=0x7fd61412e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:46.397 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.389+0000 7fd619a66700 1 --2- 172.21.15.139:0/2554199769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6140a21f0 0x7fd61412e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:46.397 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.389+0000 7fd619a66700 1 -- 172.21.15.139:0/2554199769 >> v1:172.21.15.139:6789/0 conn(0x7fd6140a3f40 legacy=0x7fd614134df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:46.397 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.389+0000 7fd619a66700 1 -- 172.21.15.139:0/2554199769 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6140a2680 con 0x7fd614135500 2020-02-12T14:12:46.397 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.389+0000 7fd619265700 1 -- 172.21.15.139:0/2554199769 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005027992 0 0) 0x7fd6141359e0 con 0x7fd6140a3f40 2020-02-12T14:12:46.397 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.389+0000 7fd619a66700 1 --2- 172.21.15.139:0/2554199769 >> v2:172.21.15.139:3300/0 conn(0x7fd614135500 0x7fd6140a1d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd610002f30 tx=0x7fd6100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.398 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.389+0000 7fd619a66700 1 --2- 172.21.15.139:0/2554199769 >> v2:172.21.15.139:3300/0 conn(0x7fd614135500 0x7fd6140a1d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd610002f30 tx=0x7fd6100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.398 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.389+0000 7fd619a66700 1 --2- 172.21.15.139:0/2554199769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd614135500 0x7fd6140a1d90 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7fd610002f30 tx=0x7fd6100088e0).ready entity=mon.1 client_cookie=feff3a6250ab1fac server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:46.398 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.389+0000 7fd619a66700 1 --2- 172.21.15.139:0/2554199769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd614135500 0x7fd6140a1d90 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7fd610002f30 tx=0x7fd6100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.398 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.389+0000 7fd619265700 1 -- 172.21.15.139:0/2554199769 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6100116b0 con 0x7fd614135500 2020-02-12T14:12:46.398 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.389+0000 7fd619a66700 1 --2- 172.21.15.139:0/2554199769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd614135500 0x7fd6140a1d90 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7fd610002f30 tx=0x7fd6100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.398 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.389+0000 7fd619265700 1 -- 172.21.15.139:0/2554199769 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd610011810 con 0x7fd614135500 2020-02-12T14:12:46.398 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.389+0000 7fd619a66700 1 --2- 172.21.15.139:0/2554199769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd614135500 0x7fd6140a1d90 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7fd610002f30 tx=0x7fd6100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.398 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.389+0000 7fd619265700 1 -- 172.21.15.139:0/2554199769 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd610011bb0 con 0x7fd614135500 2020-02-12T14:12:46.399 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.389+0000 7fd61c4cb700 1 -- 172.21.15.139:0/2554199769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd614135500 msgr2=0x7fd6140a1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:46.399 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.389+0000 7fd61c4cb700 1 --2- 172.21.15.139:0/2554199769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd614135500 0x7fd6140a1d90 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7fd610002f30 tx=0x7fd6100088e0).stop 2020-02-12T14:12:46.399 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.389+0000 7fd61c4cb700 1 -- 172.21.15.139:0/2554199769 shutdown_connections 2020-02-12T14:12:46.399 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.389+0000 7fd61c4cb700 1 --2- 172.21.15.139:0/2554199769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6140a21f0 0x7fd61412e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:46.399 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.389+0000 7fd61c4cb700 1 --2- 172.21.15.139:0/2554199769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd614135500 0x7fd6140a1d90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:46.399 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.389+0000 7fd61c4cb700 1 -- 172.21.15.139:0/2554199769 >> 172.21.15.139:0/2554199769 conn(0x7fd614060950 msgr2=0x7fd61409d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:46.399 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.389+0000 7fd61c4cb700 1 -- 172.21.15.139:0/2554199769 shutdown_connections 2020-02-12T14:12:46.399 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.389+0000 7fd61c4cb700 1 -- 172.21.15.139:0/2554199769 wait complete. 2020-02-12T14:12:46.400 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.390+0000 7fd61c4cb700 1 Processor -- start 2020-02-12T14:12:46.400 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.390+0000 7fd61c4cb700 1 -- start start 2020-02-12T14:12:46.400 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.391+0000 7fd61c4cb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd6140a21f0 0x7fd6141303a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:46.400 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.391+0000 7fd61c4cb700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd614135500 0x7fd61412b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:46.400 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.391+0000 7fd61c4cb700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd614136f10 con 0x7fd6140a3f40 2020-02-12T14:12:46.400 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.391+0000 7fd61c4cb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd614132780 con 0x7fd6140a21f0 2020-02-12T14:12:46.400 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.391+0000 7fd61c4cb700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd614132040 con 0x7fd614135500 2020-02-12T14:12:46.401 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.391+0000 7fd619a66700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fd6140a3f40 0x7fd61412f7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35574/0 (socket says 172.21.15.139:35574) 2020-02-12T14:12:46.401 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.391+0000 7fd619a66700 1 -- 172.21.15.139:0/3923989362 learned_addr learned my addr 172.21.15.139:0/3923989362 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:46.401 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.391+0000 7fd61aa68700 1 --2- 172.21.15.139:0/3923989362 >> v2:172.21.15.139:3300/0 conn(0x7fd614135500 0x7fd61412b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:46.401 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.391+0000 7fd61a267700 1 --2- 172.21.15.139:0/3923989362 >> v2:172.21.15.72:3300/0 conn(0x7fd6140a21f0 0x7fd6141303a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:46.401 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.391+0000 7fd6037fe700 1 -- 172.21.15.139:0/3923989362 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1622798060 0 0) 0x7fd614136f10 con 0x7fd6140a3f40 2020-02-12T14:12:46.401 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.391+0000 7fd6037fe700 1 -- 172.21.15.139:0/3923989362 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5f4002fe0 con 0x7fd6140a3f40 2020-02-12T14:12:46.401 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.391+0000 7fd61aa68700 1 -- 172.21.15.139:0/3923989362 >> v2:172.21.15.72:3300/0 conn(0x7fd6140a21f0 msgr2=0x7fd6141303a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:46.402 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.391+0000 7fd61aa68700 1 --2- 172.21.15.139:0/3923989362 >> v2:172.21.15.72:3300/0 conn(0x7fd6140a21f0 0x7fd6141303a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:46.402 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.391+0000 7fd61aa68700 1 -- 172.21.15.139:0/3923989362 >> v1:172.21.15.139:6789/0 conn(0x7fd6140a3f40 legacy=0x7fd61412f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:46.402 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.391+0000 7fd61aa68700 1 -- 172.21.15.139:0/3923989362 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6141322e0 con 0x7fd614135500 2020-02-12T14:12:46.402 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.391+0000 7fd61a267700 1 --2- 172.21.15.139:0/3923989362 >> v2:172.21.15.72:3300/0 conn(0x7fd6140a21f0 0x7fd6141303a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T14:12:46.402 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.391+0000 7fd61aa68700 1 --2- 172.21.15.139:0/3923989362 >> v2:172.21.15.139:3300/0 conn(0x7fd614135500 0x7fd61412b7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd60c0032b0 tx=0x7fd60c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.402 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.391+0000 7fd61aa68700 1 --2- 172.21.15.139:0/3923989362 >> v2:172.21.15.139:3300/0 conn(0x7fd614135500 0x7fd61412b7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd60c0032b0 tx=0x7fd60c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.402 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.391+0000 7fd61aa68700 1 --2- 172.21.15.139:0/3923989362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd614135500 0x7fd61412b7f0 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7fd60c0032b0 tx=0x7fd60c010ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:46.403 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.391+0000 7fd61aa68700 1 --2- 172.21.15.139:0/3923989362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd614135500 0x7fd61412b7f0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fd60c0032b0 tx=0x7fd60c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.403 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.391+0000 7fd6037fe700 1 -- 172.21.15.139:0/3923989362 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd60c00e350 con 0x7fd614135500 2020-02-12T14:12:46.403 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.391+0000 7fd61aa68700 1 --2- 172.21.15.139:0/3923989362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd614135500 0x7fd61412b7f0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fd60c0032b0 tx=0x7fd60c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.403 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.391+0000 7fd61aa68700 1 --2- 172.21.15.139:0/3923989362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd614135500 0x7fd61412b7f0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fd60c0032b0 tx=0x7fd60c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.403 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.391+0000 7fd6037fe700 1 -- 172.21.15.139:0/3923989362 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60c005c30 con 0x7fd614135500 2020-02-12T14:12:46.403 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.392+0000 7fd61c4cb700 1 -- 172.21.15.139:0/3923989362 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd614130800 con 0x7fd614135500 2020-02-12T14:12:46.403 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.392+0000 7fd6037fe700 1 -- 172.21.15.139:0/3923989362 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd60c005e20 con 0x7fd614135500 2020-02-12T14:12:46.403 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.392+0000 7fd61c4cb700 1 -- 172.21.15.139:0/3923989362 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd614138f90 con 0x7fd614135500 2020-02-12T14:12:46.404 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.392+0000 7fd61aa68700 1 --2- 172.21.15.139:0/3923989362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd614135500 0x7fd61412b7f0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fd60c0032b0 tx=0x7fd60c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.404 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.392+0000 7fd6037fe700 1 -- 172.21.15.139:0/3923989362 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fd60c012b00 con 0x7fd614135500 2020-02-12T14:12:46.404 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.392+0000 7fd61aa68700 1 --2- 172.21.15.139:0/3923989362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd614135500 0x7fd61412b7f0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fd60c0032b0 tx=0x7fd60c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.404 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.393+0000 7fd6037fe700 1 --2- 172.21.15.139:0/3923989362 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fd5f4039f10 0x7fd5f403c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:46.404 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.393+0000 7fd6037fe700 1 -- 172.21.15.139:0/3923989362 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fd60c0498f0 con 0x7fd614135500 2020-02-12T14:12:46.404 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.393+0000 7fd61c4cb700 1 -- 172.21.15.139:0/3923989362 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd614132470 con 0x7fd614135500 2020-02-12T14:12:46.404 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.393+0000 7fd61a267700 1 --2- 172.21.15.139:0/3923989362 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fd5f4039f10 0x7fd5f403c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:46.404 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.393+0000 7fd61a267700 1 --2- 172.21.15.139:0/3923989362 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fd5f4039f10 0x7fd5f403c3d0 crc :-1 s=READY pgs=69 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:46.405 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.396+0000 7fd61aa68700 1 --2- 172.21.15.139:0/3923989362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd614135500 0x7fd61412b7f0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fd60c0032b0 tx=0x7fd60c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.405 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.396+0000 7fd6037fe700 1 -- 172.21.15.139:0/3923989362 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fd60c02ef20 con 0x7fd614135500 2020-02-12T14:12:46.534 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.532+0000 7fd61c4cb700 1 -- 172.21.15.139:0/3923989362 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd614067e20 con 0x7fd614135500 2020-02-12T14:12:46.534 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.532+0000 7fd61aa68700 1 --2- 172.21.15.139:0/3923989362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd614135500 0x7fd61412b7f0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fd60c0032b0 tx=0x7fd60c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.534 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.532+0000 7fd6037fe700 1 -- 172.21.15.139:0/3923989362 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd60c031a30 con 0x7fd614135500 2020-02-12T14:12:46.535 INFO:teuthology.orchestra.run.smithi139.stdout:55834574854 2020-02-12T14:12:46.535 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.533+0000 7fd61c4cb700 1 -- 172.21.15.139:0/3923989362 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fd5f4039f10 msgr2=0x7fd5f403c3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:46.536 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.533+0000 7fd61c4cb700 1 --2- 172.21.15.139:0/3923989362 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fd5f4039f10 0x7fd5f403c3d0 crc :-1 s=READY pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:46.536 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.533+0000 7fd61c4cb700 1 -- 172.21.15.139:0/3923989362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd614135500 msgr2=0x7fd61412b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:46.536 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.533+0000 7fd61c4cb700 1 --2- 172.21.15.139:0/3923989362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd614135500 0x7fd61412b7f0 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7fd60c0032b0 tx=0x7fd60c010ec0).stop 2020-02-12T14:12:46.536 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.533+0000 7fd61c4cb700 1 -- 172.21.15.139:0/3923989362 shutdown_connections 2020-02-12T14:12:46.536 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.533+0000 7fd61c4cb700 1 --2- 172.21.15.139:0/3923989362 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fd5f4039f10 0x7fd5f403c3d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:46.536 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.533+0000 7fd61c4cb700 1 --2- 172.21.15.139:0/3923989362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd614135500 0x7fd61412b7f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:46.536 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.533+0000 7fd61c4cb700 1 --2- 172.21.15.139:0/3923989362 >> v2:172.21.15.72:3300/0 conn(0x7fd6140a21f0 0x7fd6141303a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:46.537 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.533+0000 7fd61c4cb700 1 -- 172.21.15.139:0/3923989362 >> 172.21.15.139:0/3923989362 conn(0x7fd614060950 msgr2=0x7fd61405e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:46.537 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.533+0000 7fd61c4cb700 1 -- 172.21.15.139:0/3923989362 shutdown_connections 2020-02-12T14:12:46.537 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.533+0000 7fd61c4cb700 1 -- 172.21.15.139:0/3923989362 wait complete. 2020-02-12T14:12:46.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2020-02-12T14:12:46.546 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2020-02-12T14:12:46.651 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.649+0000 7fc2f3cbb700 1 Processor -- start 2020-02-12T14:12:46.651 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.649+0000 7fc2f3cbb700 1 -- start start 2020-02-12T14:12:46.658 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f3cbb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc2ec0a3f40 0x7fc2ec134df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:46.658 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f3cbb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ec0a24a0 0x7fc2ec12e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:46.658 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f3cbb700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2ec1359e0 con 0x7fc2ec135250 2020-02-12T14:12:46.658 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f3cbb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2ec135c80 con 0x7fc2ec0a3f40 2020-02-12T14:12:46.659 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f3cbb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec0a18f0 con 0x7fc2ec0a24a0 2020-02-12T14:12:46.659 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f1256700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fc2ec135250 0x7fc2ec0a1d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35584/0 (socket says 172.21.15.139:35584) 2020-02-12T14:12:46.659 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f1256700 1 -- 172.21.15.139:0/13695382 learned_addr learned my addr 172.21.15.139:0/13695382 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:46.659 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f2258700 1 --2- 172.21.15.139:0/13695382 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ec0a24a0 0x7fc2ec12e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:46.659 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f1a57700 1 --2- 172.21.15.139:0/13695382 >> v2:172.21.15.72:3300/0 conn(0x7fc2ec0a3f40 0x7fc2ec134df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:46.659 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f0a55700 1 -- 172.21.15.139:0/13695382 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722137451 0 0) 0x7fc2ec1359e0 con 0x7fc2ec135250 2020-02-12T14:12:46.659 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f0a55700 1 -- 172.21.15.139:0/13695382 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2d4003230 con 0x7fc2ec135250 2020-02-12T14:12:46.660 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f0a55700 1 -- 172.21.15.139:0/13695382 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 595973499 0 0) 0x7fc2d4003230 con 0x7fc2ec135250 2020-02-12T14:12:46.660 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f0a55700 1 -- 172.21.15.139:0/13695382 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ec0a24a0 msgr2=0x7fc2ec12e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:46.660 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f0a55700 1 --2- 172.21.15.139:0/13695382 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ec0a24a0 0x7fc2ec12e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:46.660 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f0a55700 1 -- 172.21.15.139:0/13695382 >> v2:172.21.15.72:3300/0 conn(0x7fc2ec0a3f40 msgr2=0x7fc2ec134df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:46.660 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f0a55700 1 --2- 172.21.15.139:0/13695382 >> v2:172.21.15.72:3300/0 conn(0x7fc2ec0a3f40 0x7fc2ec134df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:46.660 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f0a55700 1 -- 172.21.15.139:0/13695382 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ec1356e0 con 0x7fc2ec135250 2020-02-12T14:12:46.660 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f0a55700 1 -- 172.21.15.139:0/13695382 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7fc2e00016d0 con 0x7fc2ec135250 2020-02-12T14:12:46.661 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f1a57700 1 --2- 172.21.15.139:0/13695382 >> v2:172.21.15.72:3300/0 conn(0x7fc2ec0a3f40 0x7fc2ec134df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T14:12:46.661 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f2258700 1 --2- 172.21.15.139:0/13695382 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ec0a24a0 0x7fc2ec12e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T14:12:46.661 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f0a55700 1 -- 172.21.15.139:0/13695382 >> v1:172.21.15.139:6789/0 conn(0x7fc2ec135250 legacy=0x7fc2ec0a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:46.661 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f0a55700 1 --2- 172.21.15.139:0/13695382 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ec0a24a0 0x7fc2d4003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:46.661 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f0a55700 1 --2- 172.21.15.139:0/13695382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2d4003b80 0x7fc2d4004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:46.661 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f0a55700 1 --2- 172.21.15.139:0/13695382 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2d40045c0 0x7fc2d4004a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:46.661 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f0a55700 1 -- 172.21.15.139:0/13695382 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec135c80 con 0x7fc2d40045c0 2020-02-12T14:12:46.661 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f0a55700 1 -- 172.21.15.139:0/13695382 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec0a18f0 con 0x7fc2d4003b80 2020-02-12T14:12:46.662 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.650+0000 7fc2f0a55700 1 -- 172.21.15.139:0/13695382 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d4005100 con 0x7fc2ec0a24a0 2020-02-12T14:12:46.662 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.651+0000 7fc2f1256700 1 --2- 172.21.15.139:0/13695382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2d4003b80 0x7fc2d4004000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:46.662 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.651+0000 7fc2f1a57700 1 --2- 172.21.15.139:0/13695382 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ec0a24a0 0x7fc2d4003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:46.662 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.651+0000 7fc2f2258700 1 --2- 172.21.15.139:0/13695382 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2d40045c0 0x7fc2d4004a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:46.662 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.651+0000 7fc2f1256700 1 -- 172.21.15.139:0/13695382 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ec0a24a0 msgr2=0x7fc2d4003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:46.662 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.651+0000 7fc2f1256700 1 --2- 172.21.15.139:0/13695382 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ec0a24a0 0x7fc2d4003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:46.662 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.651+0000 7fc2f1256700 1 -- 172.21.15.139:0/13695382 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2d40045c0 msgr2=0x7fc2d4004a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:46.663 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.651+0000 7fc2f1256700 1 --2- 172.21.15.139:0/13695382 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2d40045c0 0x7fc2d4004a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:46.663 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.651+0000 7fc2f1256700 1 -- 172.21.15.139:0/13695382 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d4003230 con 0x7fc2d4003b80 2020-02-12T14:12:46.663 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.651+0000 7fc2f1a57700 1 --2- 172.21.15.139:0/13695382 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ec0a24a0 0x7fc2d4003720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T14:12:46.663 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.651+0000 7fc2f1256700 1 --2- 172.21.15.139:0/13695382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2d4003b80 0x7fc2d4004000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc2e00013e0 tx=0x7fc2ec135870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.663 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.651+0000 7fc2f1256700 1 --2- 172.21.15.139:0/13695382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2d4003b80 0x7fc2d4004000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc2e00013e0 tx=0x7fc2ec135870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.663 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.651+0000 7fc2f1256700 1 --2- 172.21.15.139:0/13695382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2d4003b80 0x7fc2d4004000 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7fc2e00013e0 tx=0x7fc2ec135870).ready entity=mon.1 client_cookie=86c74883efb8d7f3 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:46.663 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.651+0000 7fc2f1256700 1 --2- 172.21.15.139:0/13695382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2d4003b80 0x7fc2d4004000 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fc2e00013e0 tx=0x7fc2ec135870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.663 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.651+0000 7fc2f0a55700 1 -- 172.21.15.139:0/13695382 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2e0010dc0 con 0x7fc2d4003b80 2020-02-12T14:12:46.664 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.651+0000 7fc2f1256700 1 --2- 172.21.15.139:0/13695382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2d4003b80 0x7fc2d4004000 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fc2e00013e0 tx=0x7fc2ec135870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.664 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.651+0000 7fc2f0a55700 1 -- 172.21.15.139:0/13695382 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e00055e0 con 0x7fc2d4003b80 2020-02-12T14:12:46.664 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.651+0000 7fc2f1256700 1 --2- 172.21.15.139:0/13695382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2d4003b80 0x7fc2d4004000 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fc2e00013e0 tx=0x7fc2ec135870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.664 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.651+0000 7fc2f0a55700 1 -- 172.21.15.139:0/13695382 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2e0005940 con 0x7fc2d4003b80 2020-02-12T14:12:46.664 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.651+0000 7fc2f3cbb700 1 -- 172.21.15.139:0/13695382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2d4003b80 msgr2=0x7fc2d4004000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:46.664 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.651+0000 7fc2f3cbb700 1 --2- 172.21.15.139:0/13695382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2d4003b80 0x7fc2d4004000 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7fc2e00013e0 tx=0x7fc2ec135870).stop 2020-02-12T14:12:46.664 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.651+0000 7fc2f2258700 1 -- 172.21.15.139:0/13695382 reap_dead start 2020-02-12T14:12:46.665 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.652+0000 7fc2f3cbb700 1 -- 172.21.15.139:0/13695382 shutdown_connections 2020-02-12T14:12:46.665 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.652+0000 7fc2f3cbb700 1 -- 172.21.15.139:0/13695382 >> 172.21.15.139:0/13695382 conn(0x7fc2ec060950 msgr2=0x7fc2ec09d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:46.665 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.652+0000 7fc2f3cbb700 1 -- 172.21.15.139:0/13695382 shutdown_connections 2020-02-12T14:12:46.665 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.652+0000 7fc2f3cbb700 1 -- 172.21.15.139:0/13695382 wait complete. 2020-02-12T14:12:46.665 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.653+0000 7fc2f3cbb700 1 Processor -- start 2020-02-12T14:12:46.665 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.653+0000 7fc2f3cbb700 1 -- start start 2020-02-12T14:12:46.665 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.653+0000 7fc2f3cbb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc2ec134d00 0x7fc2ec09f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:46.666 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.653+0000 7fc2f3cbb700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc2ec143350 0x7fc2ec12b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:46.666 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.653+0000 7fc2f3cbb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2ec0a7880 con 0x7fc2ec12ba40 2020-02-12T14:12:46.666 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.653+0000 7fc2f3cbb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2ec0a4b20 con 0x7fc2ec134d00 2020-02-12T14:12:46.666 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.653+0000 7fc2f3cbb700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2ec09f350 con 0x7fc2ec143350 2020-02-12T14:12:46.666 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.653+0000 7fc2f1256700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc2ec143350 0x7fc2ec12b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:46.666 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.653+0000 7fc2f1256700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc2ec143350 0x7fc2ec12b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46960/0 (socket says 172.21.15.139:46960) 2020-02-12T14:12:46.666 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.653+0000 7fc2f1256700 1 -- 172.21.15.139:0/1621087532 learned_addr learned my addr 172.21.15.139:0/1621087532 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:46.666 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.653+0000 7fc2f1a57700 1 --2- 172.21.15.139:0/1621087532 >> v2:172.21.15.72:3300/0 conn(0x7fc2ec134d00 0x7fc2ec09f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:46.667 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.653+0000 7fc2f1256700 1 -- 172.21.15.139:0/1621087532 >> v2:172.21.15.72:3300/0 conn(0x7fc2ec134d00 msgr2=0x7fc2ec09f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:46.667 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.653+0000 7fc2f1256700 1 --2- 172.21.15.139:0/1621087532 >> v2:172.21.15.72:3300/0 conn(0x7fc2ec134d00 0x7fc2ec09f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:46.667 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.653+0000 7fc2f1256700 1 -- 172.21.15.139:0/1621087532 >> v1:172.21.15.72:6789/0 conn(0x7fc2ec12ba40 legacy=0x7fc2ec1319a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:46.667 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.654+0000 7fc2f1256700 1 -- 172.21.15.139:0/1621087532 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ec05b4b0 con 0x7fc2ec143350 2020-02-12T14:12:46.667 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.654+0000 7fc2f1256700 1 --2- 172.21.15.139:0/1621087532 >> v2:172.21.15.139:3300/0 conn(0x7fc2ec143350 0x7fc2ec12b5e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc2e00013e0 tx=0x7fc2ec135870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.667 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.654+0000 7fc2f1256700 1 --2- 172.21.15.139:0/1621087532 >> v2:172.21.15.139:3300/0 conn(0x7fc2ec143350 0x7fc2ec12b5e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc2e00013e0 tx=0x7fc2ec135870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.667 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.654+0000 7fc2f1256700 1 --2- 172.21.15.139:0/1621087532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2ec143350 0x7fc2ec12b5e0 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7fc2e00013e0 tx=0x7fc2ec135870).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:46.668 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.654+0000 7fc2f1256700 1 --2- 172.21.15.139:0/1621087532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2ec143350 0x7fc2ec12b5e0 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7fc2e00013e0 tx=0x7fc2ec135870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.668 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.654+0000 7fc2deffd700 1 -- 172.21.15.139:0/1621087532 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2e000bd80 con 0x7fc2ec143350 2020-02-12T14:12:46.668 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.654+0000 7fc2f1256700 1 --2- 172.21.15.139:0/1621087532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2ec143350 0x7fc2ec12b5e0 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7fc2e00013e0 tx=0x7fc2ec135870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.668 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.654+0000 7fc2f1256700 1 --2- 172.21.15.139:0/1621087532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2ec143350 0x7fc2ec12b5e0 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7fc2e00013e0 tx=0x7fc2ec135870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.668 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.654+0000 7fc2deffd700 1 -- 172.21.15.139:0/1621087532 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e000c890 con 0x7fc2ec143350 2020-02-12T14:12:46.668 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.654+0000 7fc2f3cbb700 1 -- 172.21.15.139:0/1621087532 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ec0a0890 con 0x7fc2ec143350 2020-02-12T14:12:46.668 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.654+0000 7fc2deffd700 1 -- 172.21.15.139:0/1621087532 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2e000cc70 con 0x7fc2ec143350 2020-02-12T14:12:46.669 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.654+0000 7fc2f3cbb700 1 -- 172.21.15.139:0/1621087532 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ec0a0010 con 0x7fc2ec143350 2020-02-12T14:12:46.669 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.654+0000 7fc2f1256700 1 --2- 172.21.15.139:0/1621087532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2ec143350 0x7fc2ec12b5e0 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7fc2e00013e0 tx=0x7fc2ec135870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.669 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.655+0000 7fc2deffd700 1 -- 172.21.15.139:0/1621087532 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fc2e00101b0 con 0x7fc2ec143350 2020-02-12T14:12:46.669 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.655+0000 7fc2f1256700 1 --2- 172.21.15.139:0/1621087532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2ec143350 0x7fc2ec12b5e0 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7fc2e00013e0 tx=0x7fc2ec135870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.669 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.655+0000 7fc2deffd700 1 --2- 172.21.15.139:0/1621087532 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fc2cc039c10 0x7fc2cc03c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:46.669 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.655+0000 7fc2deffd700 1 -- 172.21.15.139:0/1621087532 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fc2e00497a0 con 0x7fc2ec143350 2020-02-12T14:12:46.669 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.655+0000 7fc2f1a57700 1 --2- 172.21.15.139:0/1621087532 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fc2cc039c10 0x7fc2cc03c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:46.669 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.655+0000 7fc2f3cbb700 1 -- 172.21.15.139:0/1621087532 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2ec0a0a80 con 0x7fc2ec143350 2020-02-12T14:12:46.670 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.655+0000 7fc2f1a57700 1 --2- 172.21.15.139:0/1621087532 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fc2cc039c10 0x7fc2cc03c0d0 crc :-1 s=READY pgs=70 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:46.670 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.658+0000 7fc2f1256700 1 --2- 172.21.15.139:0/1621087532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2ec143350 0x7fc2ec12b5e0 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7fc2e00013e0 tx=0x7fc2ec135870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.670 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.659+0000 7fc2deffd700 1 -- 172.21.15.139:0/1621087532 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fc2e0031de0 con 0x7fc2ec143350 2020-02-12T14:12:46.795 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.793+0000 7fc2f3cbb700 1 -- 172.21.15.139:0/1621087532 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc2ec067e20 con 0x7fc2ec143350 2020-02-12T14:12:46.796 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.793+0000 7fc2f1256700 1 --2- 172.21.15.139:0/1621087532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2ec143350 0x7fc2ec12b5e0 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7fc2e00013e0 tx=0x7fc2ec135870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.796 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.793+0000 7fc2deffd700 1 -- 172.21.15.139:0/1621087532 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc2e00319c0 con 0x7fc2ec143350 2020-02-12T14:12:46.796 INFO:teuthology.orchestra.run.smithi139.stdout:55834574854 2020-02-12T14:12:46.797 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.795+0000 7fc2f3cbb700 1 -- 172.21.15.139:0/1621087532 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fc2cc039c10 msgr2=0x7fc2cc03c0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:46.798 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.795+0000 7fc2f3cbb700 1 --2- 172.21.15.139:0/1621087532 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fc2cc039c10 0x7fc2cc03c0d0 crc :-1 s=READY pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:46.798 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.795+0000 7fc2f3cbb700 1 -- 172.21.15.139:0/1621087532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2ec143350 msgr2=0x7fc2ec12b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:46.798 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.795+0000 7fc2f3cbb700 1 --2- 172.21.15.139:0/1621087532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2ec143350 0x7fc2ec12b5e0 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7fc2e00013e0 tx=0x7fc2ec135870).stop 2020-02-12T14:12:46.798 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.795+0000 7fc2f3cbb700 1 -- 172.21.15.139:0/1621087532 shutdown_connections 2020-02-12T14:12:46.798 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.795+0000 7fc2f3cbb700 1 --2- 172.21.15.139:0/1621087532 >> v2:172.21.15.72:3300/0 conn(0x7fc2ec134d00 0x7fc2ec09f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:46.798 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.795+0000 7fc2f3cbb700 1 --2- 172.21.15.139:0/1621087532 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fc2cc039c10 0x7fc2cc03c0d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:46.798 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.795+0000 7fc2f3cbb700 1 --2- 172.21.15.139:0/1621087532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2ec143350 0x7fc2ec12b5e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:46.798 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.795+0000 7fc2f3cbb700 1 -- 172.21.15.139:0/1621087532 >> 172.21.15.139:0/1621087532 conn(0x7fc2ec060950 msgr2=0x7fc2ec05e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:46.799 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.795+0000 7fc2f3cbb700 1 -- 172.21.15.139:0/1621087532 shutdown_connections 2020-02-12T14:12:46.799 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.795+0000 7fc2f3cbb700 1 -- 172.21.15.139:0/1621087532 wait complete. 2020-02-12T14:12:46.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2020-02-12T14:12:46.807 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.3 2020-02-12T14:12:46.912 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.910+0000 7f1f61aea700 1 Processor -- start 2020-02-12T14:12:46.913 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.910+0000 7f1f61aea700 1 -- start start 2020-02-12T14:12:46.919 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.911+0000 7f1f61aea700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f5c065cb0 0x7f1f5c0a6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:46.919 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.911+0000 7f1f61aea700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5c066df0 con 0x7f1f5c0a5de0 2020-02-12T14:12:46.919 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.911+0000 7f1f61aea700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5c0a6280 con 0x7f1f5c09d8b0 2020-02-12T14:12:46.919 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.911+0000 7f1f61aea700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c0a6ca0 con 0x7f1f5c065cb0 2020-02-12T14:12:46.920 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.911+0000 7f1f5b7fe700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f1f5c09d8b0 0x7f1f5c0666e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35602/0 (socket says 172.21.15.139:35602) 2020-02-12T14:12:46.920 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.911+0000 7f1f5b7fe700 1 -- 172.21.15.139:0/1897368954 learned_addr learned my addr 172.21.15.139:0/1897368954 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:46.920 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.911+0000 7f1f5bfff700 1 --2- 172.21.15.139:0/1897368954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f5c065cb0 0x7f1f5c0a6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:46.920 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.911+0000 7f1f5a7fc700 1 -- 172.21.15.139:0/1897368954 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2423792293 0 0) 0x7f1f5c0a6280 con 0x7f1f5c09d8b0 2020-02-12T14:12:46.920 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.911+0000 7f1f5a7fc700 1 -- 172.21.15.139:0/1897368954 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f48003230 con 0x7f1f5c09d8b0 2020-02-12T14:12:46.920 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.911+0000 7f1f5a7fc700 1 -- 172.21.15.139:0/1897368954 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3291292897 0 0) 0x7f1f48003230 con 0x7f1f5c09d8b0 2020-02-12T14:12:46.920 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.911+0000 7f1f5a7fc700 1 -- 172.21.15.139:0/1897368954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f5c065cb0 msgr2=0x7f1f5c0a6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:46.921 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.911+0000 7f1f5a7fc700 1 --2- 172.21.15.139:0/1897368954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f5c065cb0 0x7f1f5c0a6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:46.921 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.911+0000 7f1f5a7fc700 1 -- 172.21.15.139:0/1897368954 >> v1:172.21.15.72:6789/0 conn(0x7f1f5c0a5de0 legacy=0x7f1f5c1319a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:46.921 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.911+0000 7f1f5a7fc700 1 -- 172.21.15.139:0/1897368954 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c0a6520 con 0x7f1f5c09d8b0 2020-02-12T14:12:46.921 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.911+0000 7f1f5a7fc700 1 -- 172.21.15.139:0/1897368954 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7f1f4c0016d0 con 0x7f1f5c09d8b0 2020-02-12T14:12:46.921 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.911+0000 7f1f5a7fc700 1 -- 172.21.15.139:0/1897368954 >> v1:172.21.15.139:6789/0 conn(0x7f1f5c09d8b0 legacy=0x7f1f5c0666e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:46.921 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.911+0000 7f1f5a7fc700 1 --2- 172.21.15.139:0/1897368954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f48003750 0x7f1f48003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:46.921 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.912+0000 7f1f5a7fc700 1 --2- 172.21.15.139:0/1897368954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f5c065cb0 0x7f1f480044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:46.921 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.912+0000 7f1f5a7fc700 1 --2- 172.21.15.139:0/1897368954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f48004930 0x7f1f48004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:46.922 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.912+0000 7f1f5a7fc700 1 -- 172.21.15.139:0/1897368954 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f48005300 con 0x7f1f48004930 2020-02-12T14:12:46.922 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.912+0000 7f1f5a7fc700 1 -- 172.21.15.139:0/1897368954 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f48004120 con 0x7f1f48003750 2020-02-12T14:12:46.922 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.912+0000 7f1f5a7fc700 1 -- 172.21.15.139:0/1897368954 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f480042e0 con 0x7f1f5c065cb0 2020-02-12T14:12:46.922 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.912+0000 7f1f5b7fe700 1 --2- 172.21.15.139:0/1897368954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f48003750 0x7f1f48003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:46.922 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.912+0000 7f1f5affd700 1 --2- 172.21.15.139:0/1897368954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f5c065cb0 0x7f1f480044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:46.922 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.912+0000 7f1f5bfff700 1 --2- 172.21.15.139:0/1897368954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f48004930 0x7f1f48004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:46.922 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.912+0000 7f1f5b7fe700 1 -- 172.21.15.139:0/1897368954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f5c065cb0 msgr2=0x7f1f480044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:46.923 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.912+0000 7f1f5b7fe700 1 --2- 172.21.15.139:0/1897368954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f5c065cb0 0x7f1f480044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:46.923 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.912+0000 7f1f5b7fe700 1 -- 172.21.15.139:0/1897368954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f48004930 msgr2=0x7f1f48004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:46.923 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.912+0000 7f1f5b7fe700 1 --2- 172.21.15.139:0/1897368954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f48004930 0x7f1f48004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:46.923 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.912+0000 7f1f5b7fe700 1 -- 172.21.15.139:0/1897368954 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f48003230 con 0x7f1f48003750 2020-02-12T14:12:46.923 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.912+0000 7f1f5b7fe700 1 --2- 172.21.15.139:0/1897368954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f48003750 0x7f1f48003b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1f4c0013e0 tx=0x7f1f48004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.923 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.912+0000 7f1f5b7fe700 1 --2- 172.21.15.139:0/1897368954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f48003750 0x7f1f48003b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1f4c0013e0 tx=0x7f1f48004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.923 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.912+0000 7f1f5b7fe700 1 --2- 172.21.15.139:0/1897368954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f48003750 0x7f1f48003b70 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f1f4c0013e0 tx=0x7f1f48004420).ready entity=mon.1 client_cookie=57f8309d6ea006dc server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:46.923 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.912+0000 7f1f5b7fe700 1 --2- 172.21.15.139:0/1897368954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f48003750 0x7f1f48003b70 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f1f4c0013e0 tx=0x7f1f48004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.924 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.912+0000 7f1f5a7fc700 1 -- 172.21.15.139:0/1897368954 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f4c00e160 con 0x7f1f48003750 2020-02-12T14:12:46.924 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.912+0000 7f1f5b7fe700 1 --2- 172.21.15.139:0/1897368954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f48003750 0x7f1f48003b70 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f1f4c0013e0 tx=0x7f1f48004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.924 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.912+0000 7f1f5b7fe700 1 --2- 172.21.15.139:0/1897368954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f48003750 0x7f1f48003b70 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f1f4c0013e0 tx=0x7f1f48004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.924 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.912+0000 7f1f5a7fc700 1 -- 172.21.15.139:0/1897368954 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c00e2c0 con 0x7f1f48003750 2020-02-12T14:12:46.924 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.912+0000 7f1f5a7fc700 1 -- 172.21.15.139:0/1897368954 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f4c00e6a0 con 0x7f1f48003750 2020-02-12T14:12:46.924 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.912+0000 7f1f61aea700 1 -- 172.21.15.139:0/1897368954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f48003750 msgr2=0x7f1f48003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:46.924 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.912+0000 7f1f61aea700 1 --2- 172.21.15.139:0/1897368954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f48003750 0x7f1f48003b70 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f1f4c0013e0 tx=0x7f1f48004420).stop 2020-02-12T14:12:46.925 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.912+0000 7f1f5bfff700 1 -- 172.21.15.139:0/1897368954 reap_dead start 2020-02-12T14:12:46.925 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.913+0000 7f1f61aea700 1 -- 172.21.15.139:0/1897368954 shutdown_connections 2020-02-12T14:12:46.925 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.913+0000 7f1f61aea700 1 -- 172.21.15.139:0/1897368954 >> 172.21.15.139:0/1897368954 conn(0x7f1f5c0aa8a0 msgr2=0x7f1f5c0aacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:46.925 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.913+0000 7f1f61aea700 1 -- 172.21.15.139:0/1897368954 shutdown_connections 2020-02-12T14:12:46.925 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.913+0000 7f1f61aea700 1 -- 172.21.15.139:0/1897368954 wait complete. 2020-02-12T14:12:46.925 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.913+0000 7f1f61aea700 1 Processor -- start 2020-02-12T14:12:46.925 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.914+0000 7f1f61aea700 1 -- start start 2020-02-12T14:12:46.925 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.914+0000 7f1f61aea700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f5c09eb30 0x7f1f5c132df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:46.926 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.914+0000 7f1f61aea700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1f5c135470 0x7f1f5c0a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:46.926 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.914+0000 7f1f61aea700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5c148b00 con 0x7f1f5c0a16b0 2020-02-12T14:12:46.926 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.914+0000 7f1f61aea700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f5c1344b0 con 0x7f1f5c135470 2020-02-12T14:12:46.926 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.914+0000 7f1f61aea700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c133480 con 0x7f1f5c09eb30 2020-02-12T14:12:46.926 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.914+0000 7f1f5bfff700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f1f5c0a16b0 0x7f1f5c148f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35618/0 (socket says 172.21.15.139:35618) 2020-02-12T14:12:46.926 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.914+0000 7f1f5bfff700 1 -- 172.21.15.139:0/1118379256 learned_addr learned my addr 172.21.15.139:0/1118379256 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:46.926 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.914+0000 7f1f5b7fe700 1 --2- 172.21.15.139:0/1118379256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f5c09eb30 0x7f1f5c132df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:46.926 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.914+0000 7f1f5affd700 1 --2- 172.21.15.139:0/1118379256 >> v2:172.21.15.72:3300/0 conn(0x7f1f5c135470 0x7f1f5c0a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:46.927 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.914+0000 7f1f58ff9700 1 -- 172.21.15.139:0/1118379256 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3888129539 0 0) 0x7f1f5c148b00 con 0x7f1f5c0a16b0 2020-02-12T14:12:46.927 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.914+0000 7f1f58ff9700 1 -- 172.21.15.139:0/1118379256 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f3c002fe0 con 0x7f1f5c0a16b0 2020-02-12T14:12:46.927 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.915+0000 7f1f5b7fe700 1 -- 172.21.15.139:0/1118379256 >> v2:172.21.15.72:3300/0 conn(0x7f1f5c135470 msgr2=0x7f1f5c0a1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:46.927 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.915+0000 7f1f5b7fe700 1 --2- 172.21.15.139:0/1118379256 >> v2:172.21.15.72:3300/0 conn(0x7f1f5c135470 0x7f1f5c0a1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:46.927 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.915+0000 7f1f5b7fe700 1 -- 172.21.15.139:0/1118379256 >> v1:172.21.15.139:6789/0 conn(0x7f1f5c0a16b0 legacy=0x7f1f5c148f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:46.927 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.915+0000 7f1f5b7fe700 1 -- 172.21.15.139:0/1118379256 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c133720 con 0x7f1f5c09eb30 2020-02-12T14:12:46.927 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.915+0000 7f1f5affd700 1 --2- 172.21.15.139:0/1118379256 >> v2:172.21.15.72:3300/0 conn(0x7f1f5c135470 0x7f1f5c0a1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T14:12:46.928 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.915+0000 7f1f5b7fe700 1 --2- 172.21.15.139:0/1118379256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f5c09eb30 0x7f1f5c132df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1f4c0013e0 tx=0x7f1f48004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.928 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.915+0000 7f1f5b7fe700 1 --2- 172.21.15.139:0/1118379256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f5c09eb30 0x7f1f5c132df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1f4c0013e0 tx=0x7f1f48004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.928 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.915+0000 7f1f5b7fe700 1 --2- 172.21.15.139:0/1118379256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f5c09eb30 0x7f1f5c132df0 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7f1f4c0013e0 tx=0x7f1f48004420).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:46.928 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.915+0000 7f1f5b7fe700 1 --2- 172.21.15.139:0/1118379256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f5c09eb30 0x7f1f5c132df0 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f1f4c0013e0 tx=0x7f1f48004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.928 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.915+0000 7f1f58ff9700 1 -- 172.21.15.139:0/1118379256 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f4c00e650 con 0x7f1f5c09eb30 2020-02-12T14:12:46.928 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.915+0000 7f1f5b7fe700 1 --2- 172.21.15.139:0/1118379256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f5c09eb30 0x7f1f5c132df0 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f1f4c0013e0 tx=0x7f1f48004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.928 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.915+0000 7f1f61aea700 1 -- 172.21.15.139:0/1118379256 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f5c1339c0 con 0x7f1f5c09eb30 2020-02-12T14:12:46.928 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.915+0000 7f1f58ff9700 1 -- 172.21.15.139:0/1118379256 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c00ecb0 con 0x7f1f5c09eb30 2020-02-12T14:12:46.929 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.915+0000 7f1f5b7fe700 1 --2- 172.21.15.139:0/1118379256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f5c09eb30 0x7f1f5c132df0 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f1f4c0013e0 tx=0x7f1f48004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.929 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.915+0000 7f1f58ff9700 1 -- 172.21.15.139:0/1118379256 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f4c00ee20 con 0x7f1f5c09eb30 2020-02-12T14:12:46.929 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.915+0000 7f1f61aea700 1 -- 172.21.15.139:0/1118379256 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f5c149800 con 0x7f1f5c09eb30 2020-02-12T14:12:46.929 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.916+0000 7f1f5b7fe700 1 --2- 172.21.15.139:0/1118379256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f5c09eb30 0x7f1f5c132df0 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f1f4c0013e0 tx=0x7f1f48004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.929 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.916+0000 7f1f61aea700 1 -- 172.21.15.139:0/1118379256 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f5c0a10c0 con 0x7f1f5c09eb30 2020-02-12T14:12:46.929 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.916+0000 7f1f58ff9700 1 -- 172.21.15.139:0/1118379256 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f1f4c0047a0 con 0x7f1f5c09eb30 2020-02-12T14:12:46.929 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.916+0000 7f1f5b7fe700 1 --2- 172.21.15.139:0/1118379256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f5c09eb30 0x7f1f5c132df0 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f1f4c0013e0 tx=0x7f1f48004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.930 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.916+0000 7f1f58ff9700 1 --2- 172.21.15.139:0/1118379256 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f1f3c039ee0 0x7f1f3c03c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:46.930 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.916+0000 7f1f58ff9700 1 -- 172.21.15.139:0/1118379256 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f1f4c049b90 con 0x7f1f5c09eb30 2020-02-12T14:12:46.930 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.916+0000 7f1f5affd700 1 --2- 172.21.15.139:0/1118379256 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f1f3c039ee0 0x7f1f3c03c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:46.930 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.917+0000 7f1f5affd700 1 --2- 172.21.15.139:0/1118379256 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f1f3c039ee0 0x7f1f3c03c3a0 crc :-1 s=READY pgs=71 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:46.930 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.920+0000 7f1f5b7fe700 1 --2- 172.21.15.139:0/1118379256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f5c09eb30 0x7f1f5c132df0 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f1f4c0013e0 tx=0x7f1f48004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:46.931 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:46.920+0000 7f1f58ff9700 1 -- 172.21.15.139:0/1118379256 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f1f4c0321b0 con 0x7f1f5c09eb30 2020-02-12T14:12:47.057 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.055+0000 7f1f61aea700 1 -- 172.21.15.139:0/1118379256 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1f5c067e20 con 0x7f1f5c09eb30 2020-02-12T14:12:47.058 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.055+0000 7f1f5b7fe700 1 --2- 172.21.15.139:0/1118379256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f5c09eb30 0x7f1f5c132df0 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f1f4c0013e0 tx=0x7f1f48004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.058 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.056+0000 7f1f58ff9700 1 -- 172.21.15.139:0/1118379256 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1f4c031d70 con 0x7f1f5c09eb30 2020-02-12T14:12:47.058 INFO:teuthology.orchestra.run.smithi139.stdout:55834574854 2020-02-12T14:12:47.059 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.057+0000 7f1f61aea700 1 -- 172.21.15.139:0/1118379256 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f1f3c039ee0 msgr2=0x7f1f3c03c3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:47.059 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.057+0000 7f1f61aea700 1 --2- 172.21.15.139:0/1118379256 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f1f3c039ee0 0x7f1f3c03c3a0 crc :-1 s=READY pgs=71 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:47.059 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.057+0000 7f1f61aea700 1 -- 172.21.15.139:0/1118379256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f5c09eb30 msgr2=0x7f1f5c132df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:47.060 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.057+0000 7f1f61aea700 1 --2- 172.21.15.139:0/1118379256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f5c09eb30 0x7f1f5c132df0 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7f1f4c0013e0 tx=0x7f1f48004420).stop 2020-02-12T14:12:47.060 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.057+0000 7f1f61aea700 1 -- 172.21.15.139:0/1118379256 shutdown_connections 2020-02-12T14:12:47.060 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.057+0000 7f1f61aea700 1 --2- 172.21.15.139:0/1118379256 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f1f3c039ee0 0x7f1f3c03c3a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:47.060 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.057+0000 7f1f61aea700 1 --2- 172.21.15.139:0/1118379256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f5c09eb30 0x7f1f5c132df0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:47.060 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.057+0000 7f1f61aea700 1 --2- 172.21.15.139:0/1118379256 >> v2:172.21.15.72:3300/0 conn(0x7f1f5c135470 0x7f1f5c0a1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:47.060 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.057+0000 7f1f61aea700 1 -- 172.21.15.139:0/1118379256 >> 172.21.15.139:0/1118379256 conn(0x7f1f5c0aa8a0 msgr2=0x7f1f5c05e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:47.060 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.057+0000 7f1f61aea700 1 -- 172.21.15.139:0/1118379256 shutdown_connections 2020-02-12T14:12:47.060 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.057+0000 7f1f61aea700 1 -- 172.21.15.139:0/1118379256 wait complete. 2020-02-12T14:12:47.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2020-02-12T14:12:47.069 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.4 2020-02-12T14:12:47.177 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.175+0000 7fc10777a700 1 Processor -- start 2020-02-12T14:12:47.178 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.175+0000 7fc10777a700 1 -- start start 2020-02-12T14:12:47.184 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.176+0000 7fc10777a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc1000a3de0 0x7fc10009e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:47.184 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.176+0000 7fc10777a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc10009e930 0x7fc10005ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:47.184 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.176+0000 7fc10777a700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1000a4d80 con 0x7fc10005af80 2020-02-12T14:12:47.184 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.176+0000 7fc10777a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc10009edb0 con 0x7fc1000a3de0 2020-02-12T14:12:47.184 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.176+0000 7fc10777a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1000a4530 con 0x7fc10009e930 2020-02-12T14:12:47.185 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.176+0000 7fc105d17700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fc10005af80 0x7fc10012fac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35622/0 (socket says 172.21.15.139:35622) 2020-02-12T14:12:47.185 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.176+0000 7fc105d17700 1 -- 172.21.15.139:0/617394441 learned_addr learned my addr 172.21.15.139:0/617394441 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:47.185 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.176+0000 7fc104d15700 1 --2- 172.21.15.139:0/617394441 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc10009e930 0x7fc10005ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:47.185 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.176+0000 7fc105516700 1 --2- 172.21.15.139:0/617394441 >> v2:172.21.15.72:3300/0 conn(0x7fc1000a3de0 0x7fc10009e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:47.185 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.176+0000 7fc0effff700 1 -- 172.21.15.139:0/617394441 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192978198 0 0) 0x7fc1000a4d80 con 0x7fc10005af80 2020-02-12T14:12:47.185 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.176+0000 7fc0effff700 1 -- 172.21.15.139:0/617394441 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0e8003230 con 0x7fc10005af80 2020-02-12T14:12:47.185 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.176+0000 7fc0effff700 1 -- 172.21.15.139:0/617394441 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3679324197 0 0) 0x7fc0e8003230 con 0x7fc10005af80 2020-02-12T14:12:47.186 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.176+0000 7fc0effff700 1 -- 172.21.15.139:0/617394441 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc10009e930 msgr2=0x7fc10005ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:47.186 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.176+0000 7fc0effff700 1 --2- 172.21.15.139:0/617394441 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc10009e930 0x7fc10005ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:47.186 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.176+0000 7fc0effff700 1 -- 172.21.15.139:0/617394441 >> v2:172.21.15.72:3300/0 conn(0x7fc1000a3de0 msgr2=0x7fc10009e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:47.186 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.176+0000 7fc0effff700 1 --2- 172.21.15.139:0/617394441 >> v2:172.21.15.72:3300/0 conn(0x7fc1000a3de0 0x7fc10009e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:47.186 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.176+0000 7fc0effff700 1 -- 172.21.15.139:0/617394441 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1000a4fe0 con 0x7fc10005af80 2020-02-12T14:12:47.186 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.176+0000 7fc0effff700 1 -- 172.21.15.139:0/617394441 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7fc0f8001a50 con 0x7fc10005af80 2020-02-12T14:12:47.186 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.176+0000 7fc105516700 1 --2- 172.21.15.139:0/617394441 >> v2:172.21.15.72:3300/0 conn(0x7fc1000a3de0 0x7fc10009e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T14:12:47.186 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.176+0000 7fc0effff700 1 -- 172.21.15.139:0/617394441 >> v1:172.21.15.139:6789/0 conn(0x7fc10005af80 legacy=0x7fc10012fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:47.187 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.177+0000 7fc0effff700 1 --2- 172.21.15.139:0/617394441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0e8003720 0x7fc0e8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:47.187 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.177+0000 7fc0effff700 1 --2- 172.21.15.139:0/617394441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0e8004060 0x7fc0e8004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:47.187 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.177+0000 7fc0effff700 1 --2- 172.21.15.139:0/617394441 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc10009e930 0x7fc0e8004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:47.187 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.177+0000 7fc0effff700 1 -- 172.21.15.139:0/617394441 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10009edb0 con 0x7fc0e8003720 2020-02-12T14:12:47.187 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.177+0000 7fc0effff700 1 -- 172.21.15.139:0/617394441 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1000a4530 con 0x7fc0e8004060 2020-02-12T14:12:47.187 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.177+0000 7fc0effff700 1 -- 172.21.15.139:0/617394441 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e8004ff0 con 0x7fc10009e930 2020-02-12T14:12:47.187 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.177+0000 7fc104d15700 1 --2- 172.21.15.139:0/617394441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0e8004060 0x7fc0e8004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:47.187 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.177+0000 7fc105516700 1 --2- 172.21.15.139:0/617394441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0e8003720 0x7fc0e8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:47.188 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.177+0000 7fc105d17700 1 --2- 172.21.15.139:0/617394441 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc10009e930 0x7fc0e8004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:47.188 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.177+0000 7fc104d15700 1 -- 172.21.15.139:0/617394441 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc10009e930 msgr2=0x7fc0e8004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:47.188 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.177+0000 7fc104d15700 1 --2- 172.21.15.139:0/617394441 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc10009e930 0x7fc0e8004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:47.188 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.177+0000 7fc104d15700 1 -- 172.21.15.139:0/617394441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0e8003720 msgr2=0x7fc0e8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:47.188 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.177+0000 7fc104d15700 1 --2- 172.21.15.139:0/617394441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0e8003720 0x7fc0e8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:47.188 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.177+0000 7fc104d15700 1 -- 172.21.15.139:0/617394441 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e8003230 con 0x7fc0e8004060 2020-02-12T14:12:47.188 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.177+0000 7fc104d15700 1 --2- 172.21.15.139:0/617394441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0e8004060 0x7fc0e8004530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc0fc002f30 tx=0x7fc0fc010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.189 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.177+0000 7fc104d15700 1 --2- 172.21.15.139:0/617394441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0e8004060 0x7fc0e8004530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc0fc002f30 tx=0x7fc0fc010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.189 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.177+0000 7fc104d15700 1 --2- 172.21.15.139:0/617394441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0e8004060 0x7fc0e8004530 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7fc0fc002f30 tx=0x7fc0fc010050).ready entity=mon.1 client_cookie=8a31a44a596df655 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:47.189 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.177+0000 7fc104d15700 1 --2- 172.21.15.139:0/617394441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0e8004060 0x7fc0e8004530 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7fc0fc002f30 tx=0x7fc0fc010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.189 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.177+0000 7fc104d15700 1 --2- 172.21.15.139:0/617394441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0e8004060 0x7fc0e8004530 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7fc0fc002f30 tx=0x7fc0fc010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.189 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.177+0000 7fc0effff700 1 -- 172.21.15.139:0/617394441 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0fc008d30 con 0x7fc0e8004060 2020-02-12T14:12:47.189 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.177+0000 7fc104d15700 1 --2- 172.21.15.139:0/617394441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0e8004060 0x7fc0e8004530 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7fc0fc002f30 tx=0x7fc0fc010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.189 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.177+0000 7fc0effff700 1 -- 172.21.15.139:0/617394441 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0fc008e90 con 0x7fc0e8004060 2020-02-12T14:12:47.189 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.177+0000 7fc0effff700 1 -- 172.21.15.139:0/617394441 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0fc010ac0 con 0x7fc0e8004060 2020-02-12T14:12:47.190 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.177+0000 7fc10777a700 1 -- 172.21.15.139:0/617394441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0e8004060 msgr2=0x7fc0e8004530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:47.190 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.177+0000 7fc10777a700 1 --2- 172.21.15.139:0/617394441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0e8004060 0x7fc0e8004530 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7fc0fc002f30 tx=0x7fc0fc010050).stop 2020-02-12T14:12:47.190 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.177+0000 7fc105d17700 1 -- 172.21.15.139:0/617394441 reap_dead start 2020-02-12T14:12:47.190 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.178+0000 7fc10777a700 1 -- 172.21.15.139:0/617394441 shutdown_connections 2020-02-12T14:12:47.190 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.178+0000 7fc10777a700 1 -- 172.21.15.139:0/617394441 >> 172.21.15.139:0/617394441 conn(0x7fc100060950 msgr2=0x7fc10009d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:47.190 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.178+0000 7fc10777a700 1 -- 172.21.15.139:0/617394441 shutdown_connections 2020-02-12T14:12:47.190 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.178+0000 7fc10777a700 1 -- 172.21.15.139:0/617394441 wait complete. 2020-02-12T14:12:47.191 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.179+0000 7fc10777a700 1 Processor -- start 2020-02-12T14:12:47.191 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.179+0000 7fc10777a700 1 -- start start 2020-02-12T14:12:47.191 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.179+0000 7fc10777a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc100132d60 0x7fc100127b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:47.191 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.179+0000 7fc10777a700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc100127fa0 0x7fc10014dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:47.191 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.179+0000 7fc10777a700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1000a4220 con 0x7fc10012b410 2020-02-12T14:12:47.191 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.179+0000 7fc10777a700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1000a4b20 con 0x7fc100127fa0 2020-02-12T14:12:47.191 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.179+0000 7fc10777a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1000a0650 con 0x7fc100132d60 2020-02-12T14:12:47.191 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.179+0000 7fc105d17700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc100127fa0 0x7fc10014dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:47.192 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.179+0000 7fc105516700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fc10012b410 0x7fc100130690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35636/0 (socket says 172.21.15.139:35636) 2020-02-12T14:12:47.192 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.179+0000 7fc105d17700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc100127fa0 0x7fc10014dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47000/0 (socket says 172.21.15.139:47000) 2020-02-12T14:12:47.192 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.179+0000 7fc105516700 1 -- 172.21.15.139:0/572216739 learned_addr learned my addr 172.21.15.139:0/572216739 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:47.192 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.179+0000 7fc104d15700 1 --2- 172.21.15.139:0/572216739 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc100132d60 0x7fc100127b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:47.192 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.180+0000 7fc105d17700 1 -- 172.21.15.139:0/572216739 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc100132d60 msgr2=0x7fc100127b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:47.192 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.180+0000 7fc105d17700 1 --2- 172.21.15.139:0/572216739 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc100132d60 0x7fc100127b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:47.192 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.180+0000 7fc0ee7fc700 1 -- 172.21.15.139:0/572216739 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889368532 0 0) 0x7fc1000a4220 con 0x7fc10012b410 2020-02-12T14:12:47.192 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.180+0000 7fc105d17700 1 -- 172.21.15.139:0/572216739 >> v1:172.21.15.139:6789/0 conn(0x7fc10012b410 legacy=0x7fc100130690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:47.193 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.180+0000 7fc105d17700 1 -- 172.21.15.139:0/572216739 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1000a08f0 con 0x7fc100127fa0 2020-02-12T14:12:47.193 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.180+0000 7fc105d17700 1 --2- 172.21.15.139:0/572216739 >> v2:172.21.15.139:3300/0 conn(0x7fc100127fa0 0x7fc10014dc90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc0f8001cb0 tx=0x7fc1000a41c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.193 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.180+0000 7fc105d17700 1 --2- 172.21.15.139:0/572216739 >> v2:172.21.15.139:3300/0 conn(0x7fc100127fa0 0x7fc10014dc90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc0f8001cb0 tx=0x7fc1000a41c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.193 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.180+0000 7fc105d17700 1 --2- 172.21.15.139:0/572216739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc100127fa0 0x7fc10014dc90 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7fc0f8001cb0 tx=0x7fc1000a41c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:47.193 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.180+0000 7fc105d17700 1 --2- 172.21.15.139:0/572216739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc100127fa0 0x7fc10014dc90 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fc0f8001cb0 tx=0x7fc1000a41c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.193 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.180+0000 7fc0ee7fc700 1 -- 172.21.15.139:0/572216739 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0f8011960 con 0x7fc100127fa0 2020-02-12T14:12:47.193 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.180+0000 7fc105d17700 1 --2- 172.21.15.139:0/572216739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc100127fa0 0x7fc10014dc90 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fc0f8001cb0 tx=0x7fc1000a41c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.193 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.180+0000 7fc105d17700 1 --2- 172.21.15.139:0/572216739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc100127fa0 0x7fc10014dc90 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fc0f8001cb0 tx=0x7fc1000a41c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.194 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.180+0000 7fc0ee7fc700 1 -- 172.21.15.139:0/572216739 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f8011ac0 con 0x7fc100127fa0 2020-02-12T14:12:47.194 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.180+0000 7fc10777a700 1 -- 172.21.15.139:0/572216739 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1000a0b90 con 0x7fc100127fa0 2020-02-12T14:12:47.194 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.180+0000 7fc0ee7fc700 1 -- 172.21.15.139:0/572216739 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0f8011e20 con 0x7fc100127fa0 2020-02-12T14:12:47.194 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.180+0000 7fc10777a700 1 -- 172.21.15.139:0/572216739 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc100130da0 con 0x7fc100127fa0 2020-02-12T14:12:47.194 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.180+0000 7fc105d17700 1 --2- 172.21.15.139:0/572216739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc100127fa0 0x7fc10014dc90 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fc0f8001cb0 tx=0x7fc1000a41c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.194 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.181+0000 7fc0ee7fc700 1 -- 172.21.15.139:0/572216739 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fc0f8004930 con 0x7fc100127fa0 2020-02-12T14:12:47.194 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.181+0000 7fc105d17700 1 --2- 172.21.15.139:0/572216739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc100127fa0 0x7fc10014dc90 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fc0f8001cb0 tx=0x7fc1000a41c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.195 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.181+0000 7fc0ee7fc700 1 --2- 172.21.15.139:0/572216739 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fc0e0039ae0 0x7fc0e003bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:47.195 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.181+0000 7fc0ee7fc700 1 -- 172.21.15.139:0/572216739 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fc0f8049540 con 0x7fc100127fa0 2020-02-12T14:12:47.195 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.181+0000 7fc105516700 1 --2- 172.21.15.139:0/572216739 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fc0e0039ae0 0x7fc0e003bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:47.196 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.181+0000 7fc10777a700 1 -- 172.21.15.139:0/572216739 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1000a0d20 con 0x7fc100127fa0 2020-02-12T14:12:47.196 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.181+0000 7fc105516700 1 --2- 172.21.15.139:0/572216739 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fc0e0039ae0 0x7fc0e003bfa0 crc :-1 s=READY pgs=72 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:47.197 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.184+0000 7fc105d17700 1 --2- 172.21.15.139:0/572216739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc100127fa0 0x7fc10014dc90 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fc0f8001cb0 tx=0x7fc1000a41c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.197 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.184+0000 7fc0ee7fc700 1 -- 172.21.15.139:0/572216739 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fc0f802ec90 con 0x7fc100127fa0 2020-02-12T14:12:47.321 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.318+0000 7fc10777a700 1 -- 172.21.15.139:0/572216739 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc100067e20 con 0x7fc100127fa0 2020-02-12T14:12:47.321 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.319+0000 7fc105d17700 1 --2- 172.21.15.139:0/572216739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc100127fa0 0x7fc10014dc90 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fc0f8001cb0 tx=0x7fc1000a41c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.321 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.319+0000 7fc0ee7fc700 1 -- 172.21.15.139:0/572216739 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc0f8031740 con 0x7fc100127fa0 2020-02-12T14:12:47.322 INFO:teuthology.orchestra.run.smithi139.stdout:55834574854 2020-02-12T14:12:47.322 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.320+0000 7fc10777a700 1 -- 172.21.15.139:0/572216739 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fc0e0039ae0 msgr2=0x7fc0e003bfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:47.323 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.320+0000 7fc10777a700 1 --2- 172.21.15.139:0/572216739 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fc0e0039ae0 0x7fc0e003bfa0 crc :-1 s=READY pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:47.323 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.320+0000 7fc10777a700 1 -- 172.21.15.139:0/572216739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc100127fa0 msgr2=0x7fc10014dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:47.323 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.320+0000 7fc10777a700 1 --2- 172.21.15.139:0/572216739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc100127fa0 0x7fc10014dc90 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7fc0f8001cb0 tx=0x7fc1000a41c0).stop 2020-02-12T14:12:47.323 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.320+0000 7fc10777a700 1 -- 172.21.15.139:0/572216739 shutdown_connections 2020-02-12T14:12:47.323 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.320+0000 7fc10777a700 1 --2- 172.21.15.139:0/572216739 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fc0e0039ae0 0x7fc0e003bfa0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:47.323 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.320+0000 7fc10777a700 1 --2- 172.21.15.139:0/572216739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc100127fa0 0x7fc10014dc90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:47.323 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.320+0000 7fc10777a700 1 --2- 172.21.15.139:0/572216739 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc100132d60 0x7fc100127b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:47.324 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.320+0000 7fc10777a700 1 -- 172.21.15.139:0/572216739 >> 172.21.15.139:0/572216739 conn(0x7fc100060950 msgr2=0x7fc10005a720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:47.324 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.320+0000 7fc10777a700 1 -- 172.21.15.139:0/572216739 shutdown_connections 2020-02-12T14:12:47.324 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.320+0000 7fc10777a700 1 -- 172.21.15.139:0/572216739 wait complete. 2020-02-12T14:12:47.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.4 2020-02-12T14:12:47.333 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.5 2020-02-12T14:12:47.438 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.436+0000 7fba54272700 1 Processor -- start 2020-02-12T14:12:47.438 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.436+0000 7fba54272700 1 -- start start 2020-02-12T14:12:47.441 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.437+0000 7fba54272700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fba4c0a5a50 0x7fba4c1315b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:47.441 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.437+0000 7fba54272700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba4c0a2fb0 con 0x7fba4c131a10 2020-02-12T14:12:47.441 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.437+0000 7fba54272700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba4c0a60f0 con 0x7fba4c0a7ac0 2020-02-12T14:12:47.441 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.437+0000 7fba54272700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba4c0a5ee0 con 0x7fba4c0a5a50 2020-02-12T14:12:47.442 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.437+0000 7fba5180d700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fba4c0a5a50 0x7fba4c1315b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:47.442 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.437+0000 7fba5200e700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fba4c0a7ac0 0x7fba4c0a3db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35642/0 (socket says 172.21.15.139:35642) 2020-02-12T14:12:47.442 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.437+0000 7fba5200e700 1 -- 172.21.15.139:0/3426433417 learned_addr learned my addr 172.21.15.139:0/3426433417 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:47.442 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.437+0000 7fba5100c700 1 -- 172.21.15.139:0/3426433417 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1054819552 0 0) 0x7fba4c0a60f0 con 0x7fba4c0a7ac0 2020-02-12T14:12:47.442 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.437+0000 7fba5100c700 1 -- 172.21.15.139:0/3426433417 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba34004340 con 0x7fba4c0a7ac0 2020-02-12T14:12:47.442 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.437+0000 7fba5180d700 1 -- 172.21.15.139:0/3426433417 >> v1:172.21.15.139:6789/0 conn(0x7fba4c0a7ac0 legacy=0x7fba4c0a3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:47.442 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.437+0000 7fba5180d700 1 -- 172.21.15.139:0/3426433417 >> v1:172.21.15.72:6789/0 conn(0x7fba4c131a10 legacy=0x7fba4c13ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:47.443 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.437+0000 7fba5180d700 1 -- 172.21.15.139:0/3426433417 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4c0a3680 con 0x7fba4c0a5a50 2020-02-12T14:12:47.443 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.437+0000 7fba5180d700 1 --2- 172.21.15.139:0/3426433417 >> v2:172.21.15.139:3300/0 conn(0x7fba4c0a5a50 0x7fba4c1315b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fba4c0a3a00 tx=0x7fba40008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.443 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.437+0000 7fba5180d700 1 --2- 172.21.15.139:0/3426433417 >> v2:172.21.15.139:3300/0 conn(0x7fba4c0a5a50 0x7fba4c1315b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fba4c0a3a00 tx=0x7fba40008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.443 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.437+0000 7fba5180d700 1 --2- 172.21.15.139:0/3426433417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba4c0a5a50 0x7fba4c1315b0 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7fba4c0a3a00 tx=0x7fba40008c60).ready entity=mon.1 client_cookie=2b791b798a11cd83 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:47.443 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.437+0000 7fba5180d700 1 --2- 172.21.15.139:0/3426433417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba4c0a5a50 0x7fba4c1315b0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7fba4c0a3a00 tx=0x7fba40008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.443 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.437+0000 7fba5100c700 1 -- 172.21.15.139:0/3426433417 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba40010db0 con 0x7fba4c0a5a50 2020-02-12T14:12:47.443 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.437+0000 7fba5180d700 1 --2- 172.21.15.139:0/3426433417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba4c0a5a50 0x7fba4c1315b0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7fba4c0a3a00 tx=0x7fba40008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.444 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.437+0000 7fba5180d700 1 --2- 172.21.15.139:0/3426433417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba4c0a5a50 0x7fba4c1315b0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7fba4c0a3a00 tx=0x7fba40008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.444 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.437+0000 7fba5100c700 1 -- 172.21.15.139:0/3426433417 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba400110c0 con 0x7fba4c0a5a50 2020-02-12T14:12:47.444 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.437+0000 7fba5100c700 1 -- 172.21.15.139:0/3426433417 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba40011460 con 0x7fba4c0a5a50 2020-02-12T14:12:47.444 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.437+0000 7fba54272700 1 -- 172.21.15.139:0/3426433417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba4c0a5a50 msgr2=0x7fba4c1315b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:47.444 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.437+0000 7fba54272700 1 --2- 172.21.15.139:0/3426433417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba4c0a5a50 0x7fba4c1315b0 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7fba4c0a3a00 tx=0x7fba40008c60).stop 2020-02-12T14:12:47.444 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.438+0000 7fba54272700 1 -- 172.21.15.139:0/3426433417 shutdown_connections 2020-02-12T14:12:47.444 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.438+0000 7fba54272700 1 --2- 172.21.15.139:0/3426433417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba4c0a5a50 0x7fba4c1315b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:47.444 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.438+0000 7fba54272700 1 -- 172.21.15.139:0/3426433417 >> 172.21.15.139:0/3426433417 conn(0x7fba4c060950 msgr2=0x7fba4c09d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:47.445 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.438+0000 7fba54272700 1 -- 172.21.15.139:0/3426433417 shutdown_connections 2020-02-12T14:12:47.445 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.438+0000 7fba54272700 1 -- 172.21.15.139:0/3426433417 wait complete. 2020-02-12T14:12:47.445 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.439+0000 7fba54272700 1 Processor -- start 2020-02-12T14:12:47.445 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.439+0000 7fba54272700 1 -- start start 2020-02-12T14:12:47.448 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.439+0000 7fba54272700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fba4c131a10 0x7fba4c0a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:47.448 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.439+0000 7fba54272700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba4c09e410 con 0x7fba4c0a5a50 2020-02-12T14:12:47.448 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.439+0000 7fba54272700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba4c09fcd0 con 0x7fba4c0a7ac0 2020-02-12T14:12:47.448 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.439+0000 7fba54272700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba4c09fac0 con 0x7fba4c131a10 2020-02-12T14:12:47.449 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.440+0000 7fba5180d700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fba4c0a7ac0 0x7fba4c12e8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35650/0 (socket says 172.21.15.139:35650) 2020-02-12T14:12:47.449 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.440+0000 7fba5180d700 1 -- 172.21.15.139:0/1643464243 learned_addr learned my addr 172.21.15.139:0/1643464243 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:47.449 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.440+0000 7fba5280f700 1 --2- 172.21.15.139:0/1643464243 >> v2:172.21.15.139:3300/0 conn(0x7fba4c131a10 0x7fba4c0a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:47.449 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.440+0000 7fba3f7fe700 1 -- 172.21.15.139:0/1643464243 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3651534598 0 0) 0x7fba4c09fcd0 con 0x7fba4c0a7ac0 2020-02-12T14:12:47.449 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.440+0000 7fba3f7fe700 1 -- 172.21.15.139:0/1643464243 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba2c002fe0 con 0x7fba4c0a7ac0 2020-02-12T14:12:47.449 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.440+0000 7fba3f7fe700 1 -- 172.21.15.139:0/1643464243 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1103297667 0 0) 0x7fba4c09e410 con 0x7fba4c0a5a50 2020-02-12T14:12:47.449 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.440+0000 7fba5280f700 1 -- 172.21.15.139:0/1643464243 >> v1:172.21.15.139:6789/0 conn(0x7fba4c0a7ac0 legacy=0x7fba4c12e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:47.450 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.440+0000 7fba5280f700 1 -- 172.21.15.139:0/1643464243 >> v1:172.21.15.72:6789/0 conn(0x7fba4c0a5a50 legacy=0x7fba4c0a0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:47.450 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.440+0000 7fba5280f700 1 -- 172.21.15.139:0/1643464243 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4c09e640 con 0x7fba4c131a10 2020-02-12T14:12:47.450 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.440+0000 7fba5280f700 1 --2- 172.21.15.139:0/1643464243 >> v2:172.21.15.139:3300/0 conn(0x7fba4c131a10 0x7fba4c0a0640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fba4c0a0010 tx=0x7fba48010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.450 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.440+0000 7fba5280f700 1 --2- 172.21.15.139:0/1643464243 >> v2:172.21.15.139:3300/0 conn(0x7fba4c131a10 0x7fba4c0a0640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fba4c0a0010 tx=0x7fba48010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.450 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.440+0000 7fba5280f700 1 --2- 172.21.15.139:0/1643464243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba4c131a10 0x7fba4c0a0640 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7fba4c0a0010 tx=0x7fba48010850).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:47.450 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.440+0000 7fba5280f700 1 --2- 172.21.15.139:0/1643464243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba4c131a10 0x7fba4c0a0640 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fba4c0a0010 tx=0x7fba48010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.450 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.440+0000 7fba3f7fe700 1 -- 172.21.15.139:0/1643464243 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba48006bc0 con 0x7fba4c131a10 2020-02-12T14:12:47.450 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.440+0000 7fba54272700 1 -- 172.21.15.139:0/1643464243 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4c09e8e0 con 0x7fba4c131a10 2020-02-12T14:12:47.451 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.440+0000 7fba5280f700 1 --2- 172.21.15.139:0/1643464243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba4c131a10 0x7fba4c0a0640 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fba4c0a0010 tx=0x7fba48010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.451 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.440+0000 7fba5280f700 1 --2- 172.21.15.139:0/1643464243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba4c131a10 0x7fba4c0a0640 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fba4c0a0010 tx=0x7fba48010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.451 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.440+0000 7fba3f7fe700 1 -- 172.21.15.139:0/1643464243 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba48006d20 con 0x7fba4c131a10 2020-02-12T14:12:47.451 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.440+0000 7fba3f7fe700 1 -- 172.21.15.139:0/1643464243 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba48006e90 con 0x7fba4c131a10 2020-02-12T14:12:47.451 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.440+0000 7fba54272700 1 -- 172.21.15.139:0/1643464243 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba4c12f000 con 0x7fba4c131a10 2020-02-12T14:12:47.451 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.441+0000 7fba5280f700 1 --2- 172.21.15.139:0/1643464243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba4c131a10 0x7fba4c0a0640 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fba4c0a0010 tx=0x7fba48010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.451 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.441+0000 7fba3f7fe700 1 -- 172.21.15.139:0/1643464243 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fba4800b290 con 0x7fba4c131a10 2020-02-12T14:12:47.452 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.441+0000 7fba5280f700 1 --2- 172.21.15.139:0/1643464243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba4c131a10 0x7fba4c0a0640 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fba4c0a0010 tx=0x7fba48010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.452 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.441+0000 7fba3f7fe700 1 --2- 172.21.15.139:0/1643464243 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fba2c039e80 0x7fba2c03c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:47.452 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.441+0000 7fba54272700 1 -- 172.21.15.139:0/1643464243 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba4c09ea70 con 0x7fba4c131a10 2020-02-12T14:12:47.452 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.441+0000 7fba3f7fe700 1 -- 172.21.15.139:0/1643464243 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fba48049930 con 0x7fba4c131a10 2020-02-12T14:12:47.452 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.441+0000 7fba5200e700 1 --2- 172.21.15.139:0/1643464243 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fba2c039e80 0x7fba2c03c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:47.452 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.442+0000 7fba5200e700 1 --2- 172.21.15.139:0/1643464243 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fba2c039e80 0x7fba2c03c340 crc :-1 s=READY pgs=73 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:47.452 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.445+0000 7fba5280f700 1 --2- 172.21.15.139:0/1643464243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba4c131a10 0x7fba4c0a0640 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fba4c0a0010 tx=0x7fba48010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.453 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.445+0000 7fba3f7fe700 1 -- 172.21.15.139:0/1643464243 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fba4802ecb0 con 0x7fba4c131a10 2020-02-12T14:12:47.582 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.580+0000 7fba54272700 1 -- 172.21.15.139:0/1643464243 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fba4c067e20 con 0x7fba4c131a10 2020-02-12T14:12:47.582 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.580+0000 7fba5280f700 1 --2- 172.21.15.139:0/1643464243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba4c131a10 0x7fba4c0a0640 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fba4c0a0010 tx=0x7fba48010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.582 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.580+0000 7fba3f7fe700 1 -- 172.21.15.139:0/1643464243 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fba48031990 con 0x7fba4c131a10 2020-02-12T14:12:47.583 INFO:teuthology.orchestra.run.smithi139.stdout:55834574854 2020-02-12T14:12:47.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.581+0000 7fba54272700 1 -- 172.21.15.139:0/1643464243 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fba2c039e80 msgr2=0x7fba2c03c340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:47.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.581+0000 7fba54272700 1 --2- 172.21.15.139:0/1643464243 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fba2c039e80 0x7fba2c03c340 crc :-1 s=READY pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:47.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.581+0000 7fba54272700 1 -- 172.21.15.139:0/1643464243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba4c131a10 msgr2=0x7fba4c0a0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:47.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.581+0000 7fba54272700 1 --2- 172.21.15.139:0/1643464243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba4c131a10 0x7fba4c0a0640 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7fba4c0a0010 tx=0x7fba48010850).stop 2020-02-12T14:12:47.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.581+0000 7fba54272700 1 -- 172.21.15.139:0/1643464243 shutdown_connections 2020-02-12T14:12:47.585 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.581+0000 7fba54272700 1 --2- 172.21.15.139:0/1643464243 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fba2c039e80 0x7fba2c03c340 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:47.585 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.581+0000 7fba54272700 1 --2- 172.21.15.139:0/1643464243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba4c131a10 0x7fba4c0a0640 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:47.585 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.582+0000 7fba54272700 1 -- 172.21.15.139:0/1643464243 >> 172.21.15.139:0/1643464243 conn(0x7fba4c060950 msgr2=0x7fba4c1306e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:47.585 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.582+0000 7fba54272700 1 -- 172.21.15.139:0/1643464243 shutdown_connections 2020-02-12T14:12:47.585 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.582+0000 7fba54272700 1 -- 172.21.15.139:0/1643464243 wait complete. 2020-02-12T14:12:47.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2020-02-12T14:12:47.594 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.6 2020-02-12T14:12:47.700 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.697+0000 7f020aa41700 1 Processor -- start 2020-02-12T14:12:47.700 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.697+0000 7f020aa41700 1 -- start start 2020-02-12T14:12:47.702 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.698+0000 7f020aa41700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0204135500 0x7f02040a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:47.703 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.698+0000 7f020aa41700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02041359e0 con 0x7f02040a3f40 2020-02-12T14:12:47.703 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.698+0000 7f020aa41700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0204135c80 con 0x7f02040a21f0 2020-02-12T14:12:47.703 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.698+0000 7f020aa41700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02040a18f0 con 0x7f0204135500 2020-02-12T14:12:47.703 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.698+0000 7f02037fe700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0204135500 0x7f02040a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:47.703 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.698+0000 7f0208fde700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f02040a21f0 0x7f020412e6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35660/0 (socket says 172.21.15.139:35660) 2020-02-12T14:12:47.703 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.698+0000 7f0208fde700 1 -- 172.21.15.139:0/3601364790 learned_addr learned my addr 172.21.15.139:0/3601364790 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:47.703 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.698+0000 7f02037fe700 1 -- 172.21.15.139:0/3601364790 >> v1:172.21.15.139:6789/0 conn(0x7f02040a21f0 legacy=0x7f020412e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:47.704 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.698+0000 7f02037fe700 1 -- 172.21.15.139:0/3601364790 >> v1:172.21.15.72:6789/0 conn(0x7f02040a3f40 legacy=0x7f0204134df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:47.704 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.699+0000 7f02037fe700 1 -- 172.21.15.139:0/3601364790 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02040a2680 con 0x7f0204135500 2020-02-12T14:12:47.704 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.699+0000 7f02037fe700 1 --2- 172.21.15.139:0/3601364790 >> v2:172.21.15.139:3300/0 conn(0x7f0204135500 0x7f02040a1d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0204060f00 tx=0x7f01f80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.704 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.699+0000 7f02037fe700 1 --2- 172.21.15.139:0/3601364790 >> v2:172.21.15.139:3300/0 conn(0x7f0204135500 0x7f02040a1d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0204060f00 tx=0x7f01f80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.704 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.699+0000 7f02037fe700 1 --2- 172.21.15.139:0/3601364790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0204135500 0x7f02040a1d90 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7f0204060f00 tx=0x7f01f80088e0).ready entity=mon.1 client_cookie=23bd82e64ec43071 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:47.704 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.699+0000 7f02037fe700 1 --2- 172.21.15.139:0/3601364790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0204135500 0x7f02040a1d90 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f0204060f00 tx=0x7f01f80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.704 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.699+0000 7f02037fe700 1 --2- 172.21.15.139:0/3601364790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0204135500 0x7f02040a1d90 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f0204060f00 tx=0x7f01f80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.705 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.699+0000 7f02037fe700 1 --2- 172.21.15.139:0/3601364790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0204135500 0x7f02040a1d90 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f0204060f00 tx=0x7f01f80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.705 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.699+0000 7f0202ffd700 1 -- 172.21.15.139:0/3601364790 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01f8008e40 con 0x7f0204135500 2020-02-12T14:12:47.705 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.699+0000 7f0202ffd700 1 -- 172.21.15.139:0/3601364790 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f8011660 con 0x7f0204135500 2020-02-12T14:12:47.705 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.699+0000 7f0202ffd700 1 -- 172.21.15.139:0/3601364790 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01f8011a40 con 0x7f0204135500 2020-02-12T14:12:47.705 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.699+0000 7f020aa41700 1 -- 172.21.15.139:0/3601364790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0204135500 msgr2=0x7f02040a1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:47.705 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.699+0000 7f020aa41700 1 --2- 172.21.15.139:0/3601364790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0204135500 0x7f02040a1d90 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7f0204060f00 tx=0x7f01f80088e0).stop 2020-02-12T14:12:47.705 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.699+0000 7f020aa41700 1 -- 172.21.15.139:0/3601364790 shutdown_connections 2020-02-12T14:12:47.706 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.699+0000 7f020aa41700 1 --2- 172.21.15.139:0/3601364790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0204135500 0x7f02040a1d90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:47.706 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.699+0000 7f020aa41700 1 -- 172.21.15.139:0/3601364790 >> 172.21.15.139:0/3601364790 conn(0x7f0204060950 msgr2=0x7f020409d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:47.706 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.699+0000 7f020aa41700 1 -- 172.21.15.139:0/3601364790 shutdown_connections 2020-02-12T14:12:47.706 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.700+0000 7f020aa41700 1 -- 172.21.15.139:0/3601364790 wait complete. 2020-02-12T14:12:47.706 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.700+0000 7f020aa41700 1 Processor -- start 2020-02-12T14:12:47.706 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.700+0000 7f020aa41700 1 -- start start 2020-02-12T14:12:47.709 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.701+0000 7f020aa41700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f02040a21f0 0x7f020409fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:47.709 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.701+0000 7f020aa41700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0204135500 0x7f0204126c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:47.709 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.701+0000 7f020aa41700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020409e200 con 0x7f02040a3f40 2020-02-12T14:12:47.710 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.701+0000 7f020aa41700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02040a0180 con 0x7f0204135500 2020-02-12T14:12:47.710 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.701+0000 7f020aa41700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f020409e430 con 0x7f02040a21f0 2020-02-12T14:12:47.710 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.701+0000 7f0203fff700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f02040a21f0 0x7f020409fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:47.710 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.701+0000 7f0203fff700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f02040a21f0 0x7f020409fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47024/0 (socket says 172.21.15.139:47024) 2020-02-12T14:12:47.710 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.701+0000 7f0203fff700 1 -- 172.21.15.139:0/3006719823 learned_addr learned my addr 172.21.15.139:0/3006719823 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:47.710 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.701+0000 7f0208fde700 1 --2- 172.21.15.139:0/3006719823 >> v2:172.21.15.72:3300/0 conn(0x7f0204135500 0x7f0204126c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:47.711 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.701+0000 7f0203fff700 1 -- 172.21.15.139:0/3006719823 >> v2:172.21.15.72:3300/0 conn(0x7f0204135500 msgr2=0x7f0204126c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:47.711 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.701+0000 7f0203fff700 1 --2- 172.21.15.139:0/3006719823 >> v2:172.21.15.72:3300/0 conn(0x7f0204135500 0x7f0204126c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:47.711 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.701+0000 7f0203fff700 1 -- 172.21.15.139:0/3006719823 >> v1:172.21.15.72:6789/0 conn(0x7f02040a3f40 legacy=0x7f0204126500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:47.711 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.702+0000 7f0203fff700 1 -- 172.21.15.139:0/3006719823 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020409e970 con 0x7f02040a21f0 2020-02-12T14:12:47.711 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.702+0000 7f0203fff700 1 --2- 172.21.15.139:0/3006719823 >> v2:172.21.15.139:3300/0 conn(0x7f02040a21f0 0x7f020409fd20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f020412dde0 tx=0x7f01f4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.711 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.702+0000 7f0203fff700 1 --2- 172.21.15.139:0/3006719823 >> v2:172.21.15.139:3300/0 conn(0x7f02040a21f0 0x7f020409fd20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f020412dde0 tx=0x7f01f4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.711 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.702+0000 7f0203fff700 1 --2- 172.21.15.139:0/3006719823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02040a21f0 0x7f020409fd20 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7f020412dde0 tx=0x7f01f4010a10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:47.712 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.702+0000 7f0203fff700 1 --2- 172.21.15.139:0/3006719823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02040a21f0 0x7f020409fd20 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f020412dde0 tx=0x7f01f4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.712 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.702+0000 7f02017fa700 1 -- 172.21.15.139:0/3006719823 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01f400cc20 con 0x7f02040a21f0 2020-02-12T14:12:47.712 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.702+0000 7f0203fff700 1 --2- 172.21.15.139:0/3006719823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02040a21f0 0x7f020409fd20 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f020412dde0 tx=0x7f01f4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.712 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.702+0000 7f0203fff700 1 --2- 172.21.15.139:0/3006719823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02040a21f0 0x7f020409fd20 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f020412dde0 tx=0x7f01f4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.712 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.702+0000 7f02017fa700 1 -- 172.21.15.139:0/3006719823 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f400cd80 con 0x7f02040a21f0 2020-02-12T14:12:47.712 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.702+0000 7f020aa41700 1 -- 172.21.15.139:0/3006719823 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020409e6d0 con 0x7f02040a21f0 2020-02-12T14:12:47.712 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.702+0000 7f02017fa700 1 -- 172.21.15.139:0/3006719823 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01f400e350 con 0x7f02040a21f0 2020-02-12T14:12:47.713 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.702+0000 7f020aa41700 1 -- 172.21.15.139:0/3006719823 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02040a0fd0 con 0x7f02040a21f0 2020-02-12T14:12:47.713 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.702+0000 7f0203fff700 1 --2- 172.21.15.139:0/3006719823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02040a21f0 0x7f020409fd20 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f020412dde0 tx=0x7f01f4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.713 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.703+0000 7f02017fa700 1 -- 172.21.15.139:0/3006719823 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f01f400e5c0 con 0x7f02040a21f0 2020-02-12T14:12:47.713 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.703+0000 7f0203fff700 1 --2- 172.21.15.139:0/3006719823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02040a21f0 0x7f020409fd20 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f020412dde0 tx=0x7f01f4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.713 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.703+0000 7f020aa41700 1 -- 172.21.15.139:0/3006719823 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02040aa0c0 con 0x7f02040a21f0 2020-02-12T14:12:47.713 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.703+0000 7f02017fa700 1 --2- 172.21.15.139:0/3006719823 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f01e4039c70 0x7f01e403c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:47.713 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.703+0000 7f02017fa700 1 -- 172.21.15.139:0/3006719823 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f01f4049870 con 0x7f02040a21f0 2020-02-12T14:12:47.714 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.703+0000 7f02037fe700 1 --2- 172.21.15.139:0/3006719823 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f01e4039c70 0x7f01e403c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:47.714 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.703+0000 7f02037fe700 1 --2- 172.21.15.139:0/3006719823 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f01e4039c70 0x7f01e403c130 crc :-1 s=READY pgs=74 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:47.714 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.706+0000 7f0203fff700 1 --2- 172.21.15.139:0/3006719823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02040a21f0 0x7f020409fd20 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f020412dde0 tx=0x7f01f4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.714 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.706+0000 7f02017fa700 1 -- 172.21.15.139:0/3006719823 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f01f402eec0 con 0x7f02040a21f0 2020-02-12T14:12:47.844 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.841+0000 7f020aa41700 1 -- 172.21.15.139:0/3006719823 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0204067e20 con 0x7f02040a21f0 2020-02-12T14:12:47.844 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.841+0000 7f0203fff700 1 --2- 172.21.15.139:0/3006719823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02040a21f0 0x7f020409fd20 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f020412dde0 tx=0x7f01f4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.844 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.841+0000 7f02017fa700 1 -- 172.21.15.139:0/3006719823 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f01f40319b0 con 0x7f02040a21f0 2020-02-12T14:12:47.845 INFO:teuthology.orchestra.run.smithi139.stdout:55834574855 2020-02-12T14:12:47.846 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.843+0000 7f020aa41700 1 -- 172.21.15.139:0/3006719823 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f01e4039c70 msgr2=0x7f01e403c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:47.846 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.843+0000 7f020aa41700 1 --2- 172.21.15.139:0/3006719823 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f01e4039c70 0x7f01e403c130 crc :-1 s=READY pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:47.846 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.843+0000 7f020aa41700 1 -- 172.21.15.139:0/3006719823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02040a21f0 msgr2=0x7f020409fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:47.846 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.843+0000 7f020aa41700 1 --2- 172.21.15.139:0/3006719823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02040a21f0 0x7f020409fd20 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7f020412dde0 tx=0x7f01f4010a10).stop 2020-02-12T14:12:47.846 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.843+0000 7f020aa41700 1 -- 172.21.15.139:0/3006719823 shutdown_connections 2020-02-12T14:12:47.847 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.843+0000 7f020aa41700 1 --2- 172.21.15.139:0/3006719823 >> v2:172.21.15.72:3300/0 conn(0x7f0204135500 0x7f0204126c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:47.847 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.843+0000 7f020aa41700 1 --2- 172.21.15.139:0/3006719823 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f01e4039c70 0x7f01e403c130 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:47.847 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.843+0000 7f020aa41700 1 --2- 172.21.15.139:0/3006719823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02040a21f0 0x7f020409fd20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:47.847 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.843+0000 7f020aa41700 1 -- 172.21.15.139:0/3006719823 >> 172.21.15.139:0/3006719823 conn(0x7f0204060950 msgr2=0x7f020405e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:47.848 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.843+0000 7f020aa41700 1 -- 172.21.15.139:0/3006719823 shutdown_connections 2020-02-12T14:12:47.848 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.843+0000 7f020aa41700 1 -- 172.21.15.139:0/3006719823 wait complete. 2020-02-12T14:12:47.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2020-02-12T14:12:47.855 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.7 2020-02-12T14:12:47.962 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.959+0000 7f62599c7700 1 Processor -- start 2020-02-12T14:12:47.962 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.959+0000 7f62599c7700 1 -- start start 2020-02-12T14:12:47.965 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.960+0000 7f62599c7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f62540a3f40 0x7f6254134df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:47.965 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.960+0000 7f62599c7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62541359e0 con 0x7f6254135250 2020-02-12T14:12:47.965 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.960+0000 7f62599c7700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6254135c80 con 0x7f62540a24a0 2020-02-12T14:12:47.965 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.960+0000 7f62599c7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62540a18f0 con 0x7f62540a3f40 2020-02-12T14:12:47.965 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.960+0000 7f62537fe700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f62540a24a0 0x7f625412e6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35670/0 (socket says 172.21.15.139:35670) 2020-02-12T14:12:47.966 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.960+0000 7f62537fe700 1 -- 172.21.15.139:0/1796208990 learned_addr learned my addr 172.21.15.139:0/1796208990 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:47.966 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.960+0000 7f6252ffd700 1 --2- 172.21.15.139:0/1796208990 >> v2:172.21.15.72:3300/0 conn(0x7f62540a3f40 0x7f6254134df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:47.966 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.960+0000 7f6251ffb700 1 -- 172.21.15.139:0/1796208990 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4066854009 0 0) 0x7f6254135c80 con 0x7f62540a24a0 2020-02-12T14:12:47.966 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.961+0000 7f6251ffb700 1 -- 172.21.15.139:0/1796208990 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6238003230 con 0x7f62540a24a0 2020-02-12T14:12:47.966 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.961+0000 7f6252ffd700 1 -- 172.21.15.139:0/1796208990 >> v1:172.21.15.139:6789/0 conn(0x7f62540a24a0 legacy=0x7f625412e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:47.966 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.961+0000 7f6252ffd700 1 -- 172.21.15.139:0/1796208990 >> v1:172.21.15.72:6789/0 conn(0x7f6254135250 legacy=0x7f62540a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:47.966 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.961+0000 7f6252ffd700 1 -- 172.21.15.139:0/1796208990 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62541356e0 con 0x7f62540a3f40 2020-02-12T14:12:47.966 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.961+0000 7f6252ffd700 1 --2- 172.21.15.139:0/1796208990 >> v2:172.21.15.72:3300/0 conn(0x7f62540a3f40 0x7f6254134df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6248002f30 tx=0x7f62480088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.967 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.961+0000 7f6252ffd700 1 --2- 172.21.15.139:0/1796208990 >> v2:172.21.15.72:3300/0 conn(0x7f62540a3f40 0x7f6254134df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6248002f30 tx=0x7f62480088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.967 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.961+0000 7f6252ffd700 1 --2- 172.21.15.139:0/1796208990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62540a3f40 0x7f6254134df0 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f6248002f30 tx=0x7f62480088e0).ready entity=mon.0 client_cookie=fe832e89b2bfe918 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:47.967 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.961+0000 7f6252ffd700 1 --2- 172.21.15.139:0/1796208990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62540a3f40 0x7f6254134df0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f6248002f30 tx=0x7f62480088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.967 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.961+0000 7f6251ffb700 1 -- 172.21.15.139:0/1796208990 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6248008e40 con 0x7f62540a3f40 2020-02-12T14:12:47.967 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.961+0000 7f6252ffd700 1 --2- 172.21.15.139:0/1796208990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62540a3f40 0x7f6254134df0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f6248002f30 tx=0x7f62480088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.967 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.961+0000 7f6252ffd700 1 --2- 172.21.15.139:0/1796208990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62540a3f40 0x7f6254134df0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f6248002f30 tx=0x7f62480088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.967 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.961+0000 7f6251ffb700 1 -- 172.21.15.139:0/1796208990 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62480115f0 con 0x7f62540a3f40 2020-02-12T14:12:47.968 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.961+0000 7f6251ffb700 1 -- 172.21.15.139:0/1796208990 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6248011950 con 0x7f62540a3f40 2020-02-12T14:12:47.968 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.961+0000 7f62599c7700 1 -- 172.21.15.139:0/1796208990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62540a3f40 msgr2=0x7f6254134df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:47.968 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.961+0000 7f62599c7700 1 --2- 172.21.15.139:0/1796208990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62540a3f40 0x7f6254134df0 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f6248002f30 tx=0x7f62480088e0).stop 2020-02-12T14:12:47.968 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.962+0000 7f62599c7700 1 -- 172.21.15.139:0/1796208990 shutdown_connections 2020-02-12T14:12:47.968 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.962+0000 7f62599c7700 1 --2- 172.21.15.139:0/1796208990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62540a3f40 0x7f6254134df0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:47.968 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.962+0000 7f62599c7700 1 -- 172.21.15.139:0/1796208990 >> 172.21.15.139:0/1796208990 conn(0x7f6254060950 msgr2=0x7f625409d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:47.968 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.962+0000 7f62599c7700 1 -- 172.21.15.139:0/1796208990 shutdown_connections 2020-02-12T14:12:47.969 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.962+0000 7f62599c7700 1 -- 172.21.15.139:0/1796208990 wait complete. 2020-02-12T14:12:47.969 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.962+0000 7f62599c7700 1 Processor -- start 2020-02-12T14:12:47.969 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.962+0000 7f62599c7700 1 -- start start 2020-02-12T14:12:47.971 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.963+0000 7f62599c7700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f62540a3f40 0x7f6254135fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:47.972 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.963+0000 7f62599c7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6254135250 0x7f6254136430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:47.972 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.963+0000 7f62599c7700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6254136ee0 con 0x7f62540a24a0 2020-02-12T14:12:47.972 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.963+0000 7f62599c7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6254131ff0 con 0x7f6254135250 2020-02-12T14:12:47.972 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.963+0000 7f62599c7700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6254137110 con 0x7f62540a3f40 2020-02-12T14:12:47.972 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.963+0000 7f62527fc700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f62540a3f40 0x7f6254135fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:47.972 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.963+0000 7f6252ffd700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f62540a24a0 0x7f625412b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35676/0 (socket says 172.21.15.139:35676) 2020-02-12T14:12:47.973 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.963+0000 7f6252ffd700 1 -- 172.21.15.139:0/707226423 learned_addr learned my addr 172.21.15.139:0/707226423 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:47.973 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.963+0000 7f62537fe700 1 --2- 172.21.15.139:0/707226423 >> v2:172.21.15.72:3300/0 conn(0x7f6254135250 0x7f6254136430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:47.973 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.963+0000 7f62527fc700 1 -- 172.21.15.139:0/707226423 >> v2:172.21.15.72:3300/0 conn(0x7f6254135250 msgr2=0x7f6254136430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:47.973 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.963+0000 7f62527fc700 1 --2- 172.21.15.139:0/707226423 >> v2:172.21.15.72:3300/0 conn(0x7f6254135250 0x7f6254136430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:47.973 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.963+0000 7f62527fc700 1 -- 172.21.15.139:0/707226423 >> v1:172.21.15.139:6789/0 conn(0x7f62540a24a0 legacy=0x7f625412b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:47.973 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.963+0000 7f6243fff700 1 -- 172.21.15.139:0/707226423 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 111786204 0 0) 0x7f6254136ee0 con 0x7f62540a24a0 2020-02-12T14:12:47.973 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.963+0000 7f62527fc700 1 -- 172.21.15.139:0/707226423 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62541373b0 con 0x7f62540a3f40 2020-02-12T14:12:47.974 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.963+0000 7f62527fc700 1 --2- 172.21.15.139:0/707226423 >> v2:172.21.15.139:3300/0 conn(0x7f62540a3f40 0x7f6254135fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6254060f00 tx=0x7f6244010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.974 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.963+0000 7f62527fc700 1 --2- 172.21.15.139:0/707226423 >> v2:172.21.15.139:3300/0 conn(0x7f62540a3f40 0x7f6254135fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6254060f00 tx=0x7f6244010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.974 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.964+0000 7f62527fc700 1 --2- 172.21.15.139:0/707226423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62540a3f40 0x7f6254135fd0 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7f6254060f00 tx=0x7f6244010990).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:47.974 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.964+0000 7f62527fc700 1 --2- 172.21.15.139:0/707226423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62540a3f40 0x7f6254135fd0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f6254060f00 tx=0x7f6244010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.974 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.964+0000 7f6243fff700 1 -- 172.21.15.139:0/707226423 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f624400cc00 con 0x7f62540a3f40 2020-02-12T14:12:47.974 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.964+0000 7f62527fc700 1 --2- 172.21.15.139:0/707226423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62540a3f40 0x7f6254135fd0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f6254060f00 tx=0x7f6244010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.974 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.964+0000 7f6243fff700 1 -- 172.21.15.139:0/707226423 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624400cd60 con 0x7f62540a3f40 2020-02-12T14:12:47.974 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.964+0000 7f62527fc700 1 --2- 172.21.15.139:0/707226423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62540a3f40 0x7f6254135fd0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f6254060f00 tx=0x7f6244010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.975 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.964+0000 7f62599c7700 1 -- 172.21.15.139:0/707226423 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f625412c080 con 0x7f62540a3f40 2020-02-12T14:12:47.975 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.964+0000 7f6243fff700 1 -- 172.21.15.139:0/707226423 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6244011170 con 0x7f62540a3f40 2020-02-12T14:12:47.975 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.964+0000 7f62599c7700 1 -- 172.21.15.139:0/707226423 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6254138f30 con 0x7f62540a3f40 2020-02-12T14:12:47.975 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.964+0000 7f62527fc700 1 --2- 172.21.15.139:0/707226423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62540a3f40 0x7f6254135fd0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f6254060f00 tx=0x7f6244010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.975 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.964+0000 7f6243fff700 1 -- 172.21.15.139:0/707226423 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f62440064e0 con 0x7f62540a3f40 2020-02-12T14:12:47.975 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.964+0000 7f62527fc700 1 --2- 172.21.15.139:0/707226423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62540a3f40 0x7f6254135fd0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f6254060f00 tx=0x7f6244010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.975 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.965+0000 7f62599c7700 1 -- 172.21.15.139:0/707226423 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62540a0cf0 con 0x7f62540a3f40 2020-02-12T14:12:47.975 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.965+0000 7f6243fff700 1 --2- 172.21.15.139:0/707226423 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f6230039aa0 0x7f623003bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:47.976 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.965+0000 7f6243fff700 1 -- 172.21.15.139:0/707226423 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f62440495b0 con 0x7f62540a3f40 2020-02-12T14:12:47.976 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.965+0000 7f6252ffd700 1 --2- 172.21.15.139:0/707226423 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f6230039aa0 0x7f623003bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:47.976 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.965+0000 7f6252ffd700 1 --2- 172.21.15.139:0/707226423 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f6230039aa0 0x7f623003bf60 crc :-1 s=READY pgs=75 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:47.976 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.968+0000 7f62527fc700 1 --2- 172.21.15.139:0/707226423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62540a3f40 0x7f6254135fd0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f6254060f00 tx=0x7f6244010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:47.976 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:47.968+0000 7f6243fff700 1 -- 172.21.15.139:0/707226423 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f624402eb00 con 0x7f62540a3f40 2020-02-12T14:12:48.108 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.106+0000 7f62599c7700 1 -- 172.21.15.139:0/707226423 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f6254137540 con 0x7f62540a3f40 2020-02-12T14:12:48.109 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.106+0000 7f62527fc700 1 --2- 172.21.15.139:0/707226423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62540a3f40 0x7f6254135fd0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f6254060f00 tx=0x7f6244010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.109 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.106+0000 7f6243fff700 1 -- 172.21.15.139:0/707226423 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6244031610 con 0x7f62540a3f40 2020-02-12T14:12:48.109 INFO:teuthology.orchestra.run.smithi139.stdout:55834574853 2020-02-12T14:12:48.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.108+0000 7f62599c7700 1 -- 172.21.15.139:0/707226423 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f6230039aa0 msgr2=0x7f623003bf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:48.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.108+0000 7f62599c7700 1 --2- 172.21.15.139:0/707226423 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f6230039aa0 0x7f623003bf60 crc :-1 s=READY pgs=75 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:48.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.108+0000 7f62599c7700 1 -- 172.21.15.139:0/707226423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62540a3f40 msgr2=0x7f6254135fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:48.110 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.108+0000 7f62599c7700 1 --2- 172.21.15.139:0/707226423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62540a3f40 0x7f6254135fd0 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7f6254060f00 tx=0x7f6244010990).stop 2020-02-12T14:12:48.111 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.108+0000 7f62599c7700 1 -- 172.21.15.139:0/707226423 shutdown_connections 2020-02-12T14:12:48.111 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.108+0000 7f62599c7700 1 --2- 172.21.15.139:0/707226423 >> v2:172.21.15.72:3300/0 conn(0x7f6254135250 0x7f6254136430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:48.111 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.108+0000 7f62599c7700 1 --2- 172.21.15.139:0/707226423 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f6230039aa0 0x7f623003bf60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:48.111 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.108+0000 7f62599c7700 1 --2- 172.21.15.139:0/707226423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62540a3f40 0x7f6254135fd0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:48.111 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.108+0000 7f62599c7700 1 -- 172.21.15.139:0/707226423 >> 172.21.15.139:0/707226423 conn(0x7f6254060950 msgr2=0x7f625405e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:48.111 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.108+0000 7f62599c7700 1 -- 172.21.15.139:0/707226423 shutdown_connections 2020-02-12T14:12:48.111 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.108+0000 7f62599c7700 1 -- 172.21.15.139:0/707226423 wait complete. 2020-02-12T14:12:48.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2020-02-12T14:12:48.120 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-02-12T14:12:48.120 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-02-12T14:12:48.225 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.223+0000 7f76d8331700 1 Processor -- start 2020-02-12T14:12:48.225 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.223+0000 7f76d8331700 1 -- start start 2020-02-12T14:12:48.233 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.223+0000 7f76d8331700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76d00a3f40 0x7f76d0134df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:48.233 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.223+0000 7f76d8331700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f76d0135250 0x7f76d00a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:48.233 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.223+0000 7f76d8331700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d01359e0 con 0x7f76d00a21f0 2020-02-12T14:12:48.234 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.223+0000 7f76d8331700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d0135c80 con 0x7f76d0135250 2020-02-12T14:12:48.235 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.223+0000 7f76d8331700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d00a18f0 con 0x7f76d00a3f40 2020-02-12T14:12:48.235 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.224+0000 7f76d58cc700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f76d0135250 0x7f76d00a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:48.235 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.224+0000 7f76d68ce700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f76d00a21f0 0x7f76d0138340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35684/0 (socket says 172.21.15.139:35684) 2020-02-12T14:12:48.235 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.224+0000 7f76d68ce700 1 -- 172.21.15.139:0/242374795 learned_addr learned my addr 172.21.15.139:0/242374795 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:48.235 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.224+0000 7f76d60cd700 1 --2- 172.21.15.139:0/242374795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76d00a3f40 0x7f76d0134df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:48.235 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.224+0000 7f76d58cc700 1 -- 172.21.15.139:0/242374795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76d00a3f40 msgr2=0x7f76d0134df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:48.236 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.224+0000 7f76d58cc700 1 --2- 172.21.15.139:0/242374795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76d00a3f40 0x7f76d0134df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:48.236 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.224+0000 7f76d58cc700 1 -- 172.21.15.139:0/242374795 >> v1:172.21.15.139:6789/0 conn(0x7f76d00a21f0 legacy=0x7f76d0138340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:48.236 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.224+0000 7f76d50cb700 1 -- 172.21.15.139:0/242374795 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433743916 0 0) 0x7f76d01359e0 con 0x7f76d00a21f0 2020-02-12T14:12:48.236 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.224+0000 7f76d58cc700 1 -- 172.21.15.139:0/242374795 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d01356b0 con 0x7f76d0135250 2020-02-12T14:12:48.236 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.224+0000 7f76d60cd700 1 --2- 172.21.15.139:0/242374795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76d00a3f40 0x7f76d0134df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-12T14:12:48.236 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.224+0000 7f76d58cc700 1 --2- 172.21.15.139:0/242374795 >> v2:172.21.15.139:3300/0 conn(0x7f76d0135250 0x7f76d00a1d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f76c4002f30 tx=0x7f76c40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.237 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.224+0000 7f76d58cc700 1 --2- 172.21.15.139:0/242374795 >> v2:172.21.15.139:3300/0 conn(0x7f76d0135250 0x7f76d00a1d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f76c4002f30 tx=0x7f76c40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.237 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.224+0000 7f76d58cc700 1 --2- 172.21.15.139:0/242374795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76d0135250 0x7f76d00a1d90 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7f76c4002f30 tx=0x7f76c40088e0).ready entity=mon.1 client_cookie=b35fd50ce3bc01f1 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:48.237 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.224+0000 7f76d58cc700 1 --2- 172.21.15.139:0/242374795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76d0135250 0x7f76d00a1d90 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f76c4002f30 tx=0x7f76c40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.237 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.224+0000 7f76d50cb700 1 -- 172.21.15.139:0/242374795 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76c4008e40 con 0x7f76d0135250 2020-02-12T14:12:48.237 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.224+0000 7f76d58cc700 1 --2- 172.21.15.139:0/242374795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76d0135250 0x7f76d00a1d90 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f76c4002f30 tx=0x7f76c40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.238 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.224+0000 7f76d50cb700 1 -- 172.21.15.139:0/242374795 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c40116a0 con 0x7f76d0135250 2020-02-12T14:12:48.238 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.224+0000 7f76d58cc700 1 --2- 172.21.15.139:0/242374795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76d0135250 0x7f76d00a1d90 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f76c4002f30 tx=0x7f76c40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.238 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.224+0000 7f76d50cb700 1 -- 172.21.15.139:0/242374795 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76c4011a40 con 0x7f76d0135250 2020-02-12T14:12:48.238 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.224+0000 7f76d8331700 1 -- 172.21.15.139:0/242374795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76d0135250 msgr2=0x7f76d00a1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:48.238 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.224+0000 7f76d8331700 1 --2- 172.21.15.139:0/242374795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76d0135250 0x7f76d00a1d90 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7f76c4002f30 tx=0x7f76c40088e0).stop 2020-02-12T14:12:48.239 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.225+0000 7f76d8331700 1 -- 172.21.15.139:0/242374795 shutdown_connections 2020-02-12T14:12:48.239 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.225+0000 7f76d8331700 1 --2- 172.21.15.139:0/242374795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76d00a3f40 0x7f76d0134df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:48.239 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.225+0000 7f76d8331700 1 --2- 172.21.15.139:0/242374795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76d0135250 0x7f76d00a1d90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:48.239 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.225+0000 7f76d8331700 1 -- 172.21.15.139:0/242374795 >> 172.21.15.139:0/242374795 conn(0x7f76d0060950 msgr2=0x7f76d009d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:48.240 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.225+0000 7f76d8331700 1 -- 172.21.15.139:0/242374795 shutdown_connections 2020-02-12T14:12:48.240 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.225+0000 7f76d8331700 1 -- 172.21.15.139:0/242374795 wait complete. 2020-02-12T14:12:48.240 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.226+0000 7f76d8331700 1 Processor -- start 2020-02-12T14:12:48.240 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.226+0000 7f76d8331700 1 -- start start 2020-02-12T14:12:48.240 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.226+0000 7f76d8331700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76d00a21f0 0x7f76d01348b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:48.240 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.226+0000 7f76d8331700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d01380a0 con 0x7f76d0135250 2020-02-12T14:12:48.241 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.226+0000 7f76d8331700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d0134ee0 con 0x7f76d00a3f40 2020-02-12T14:12:48.241 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.226+0000 7f76d8331700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d0133d90 con 0x7f76d00a21f0 2020-02-12T14:12:48.241 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.226+0000 7f76d58cc700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f76d00a3f40 0x7f76d0137990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35690/0 (socket says 172.21.15.139:35690) 2020-02-12T14:12:48.241 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.226+0000 7f76d58cc700 1 -- 172.21.15.139:0/622563076 learned_addr learned my addr 172.21.15.139:0/622563076 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:48.241 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.226+0000 7f76c37fe700 1 -- 172.21.15.139:0/622563076 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967237798 0 0) 0x7f76d0134ee0 con 0x7f76d00a3f40 2020-02-12T14:12:48.242 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.226+0000 7f76c37fe700 1 -- 172.21.15.139:0/622563076 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76b0002fe0 con 0x7f76d00a3f40 2020-02-12T14:12:48.242 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.226+0000 7f76d60cd700 1 --2- 172.21.15.139:0/622563076 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76d00a21f0 0x7f76d01348b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:48.242 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76c37fe700 1 -- 172.21.15.139:0/622563076 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1423458554 0 0) 0x7f76b0002fe0 con 0x7f76d00a3f40 2020-02-12T14:12:48.242 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76c37fe700 1 -- 172.21.15.139:0/622563076 --> v1:172.21.15.139:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f76d0134ee0 con 0x7f76d00a3f40 2020-02-12T14:12:48.242 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76c37fe700 1 -- 172.21.15.139:0/622563076 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7f76c4008e40 con 0x7f76d00a3f40 2020-02-12T14:12:48.242 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76c37fe700 1 -- 172.21.15.139:0/622563076 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76d00a21f0 msgr2=0x7f76d01348b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:48.243 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76c37fe700 1 --2- 172.21.15.139:0/622563076 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76d00a21f0 0x7f76d01348b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:48.243 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76c37fe700 1 -- 172.21.15.139:0/622563076 >> v1:172.21.15.139:6789/0 conn(0x7f76d00a3f40 legacy=0x7f76d0137990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:48.243 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76c37fe700 1 -- 172.21.15.139:0/622563076 >> v1:172.21.15.72:6789/0 conn(0x7f76d0135250 legacy=0x7f76d0129690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:48.243 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76c37fe700 1 --2- 172.21.15.139:0/622563076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b00049b0 0x7f76b0004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:48.243 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76c37fe700 1 --2- 172.21.15.139:0/622563076 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76b00052a0 0x7f76b0003980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:48.243 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76c37fe700 1 --2- 172.21.15.139:0/622563076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76b0003f30 0x7f76b00043b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:48.244 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76c37fe700 1 -- 172.21.15.139:0/622563076 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d0133d90 con 0x7f76b00049b0 2020-02-12T14:12:48.244 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76c37fe700 1 -- 172.21.15.139:0/622563076 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b000b8b0 con 0x7f76b0003f30 2020-02-12T14:12:48.244 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76c37fe700 1 -- 172.21.15.139:0/622563076 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b000ba70 con 0x7f76b00052a0 2020-02-12T14:12:48.244 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76d60cd700 1 --2- 172.21.15.139:0/622563076 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76d00a21f0 0x7f76d01348b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T14:12:48.244 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76d68ce700 1 --2- 172.21.15.139:0/622563076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76b0003f30 0x7f76b00043b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:48.244 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76d58cc700 1 --2- 172.21.15.139:0/622563076 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76b00052a0 0x7f76b0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:48.244 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76d60cd700 1 --2- 172.21.15.139:0/622563076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b00049b0 0x7f76b0004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:48.245 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76d68ce700 1 -- 172.21.15.139:0/622563076 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76b00052a0 msgr2=0x7f76b0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:48.245 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76d68ce700 1 --2- 172.21.15.139:0/622563076 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76b00052a0 0x7f76b0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:48.245 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76d68ce700 1 -- 172.21.15.139:0/622563076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b00049b0 msgr2=0x7f76b0004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:48.245 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76d68ce700 1 --2- 172.21.15.139:0/622563076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b00049b0 0x7f76b0004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:48.245 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76d68ce700 1 -- 172.21.15.139:0/622563076 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d0134030 con 0x7f76b0003f30 2020-02-12T14:12:48.245 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76d8331700 1 -- 172.21.15.139:0/622563076 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d00a05c0 con 0x7f76b0003f30 2020-02-12T14:12:48.246 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76d68ce700 1 --2- 172.21.15.139:0/622563076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76b0003f30 0x7f76b00043b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f76d00a0410 tx=0x7f76cc010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.246 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76d8331700 1 -- 172.21.15.139:0/622563076 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d01363b0 con 0x7f76b0003f30 2020-02-12T14:12:48.246 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76d68ce700 1 --2- 172.21.15.139:0/622563076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76b0003f30 0x7f76b00043b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f76d00a0410 tx=0x7f76cc010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.246 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76d68ce700 1 --2- 172.21.15.139:0/622563076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76b0003f30 0x7f76b00043b0 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7f76d00a0410 tx=0x7f76cc010890).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:48.246 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76d68ce700 1 --2- 172.21.15.139:0/622563076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76b0003f30 0x7f76b00043b0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f76d00a0410 tx=0x7f76cc010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.246 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76c37fe700 1 -- 172.21.15.139:0/622563076 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76cc005cc0 con 0x7f76b0003f30 2020-02-12T14:12:48.247 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76d68ce700 1 --2- 172.21.15.139:0/622563076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76b0003f30 0x7f76b00043b0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f76d00a0410 tx=0x7f76cc010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.247 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76c37fe700 1 -- 172.21.15.139:0/622563076 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76cc005e20 con 0x7f76b0003f30 2020-02-12T14:12:48.247 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76d68ce700 1 --2- 172.21.15.139:0/622563076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76b0003f30 0x7f76b00043b0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f76d00a0410 tx=0x7f76cc010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.247 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.227+0000 7f76c37fe700 1 -- 172.21.15.139:0/622563076 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76cc00a510 con 0x7f76b0003f30 2020-02-12T14:12:48.247 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.228+0000 7f76d68ce700 1 --2- 172.21.15.139:0/622563076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76b0003f30 0x7f76b00043b0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f76d00a0410 tx=0x7f76cc010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.247 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.228+0000 7f76c37fe700 1 -- 172.21.15.139:0/622563076 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f76cc00a670 con 0x7f76b0003f30 2020-02-12T14:12:48.247 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.228+0000 7f76d68ce700 1 --2- 172.21.15.139:0/622563076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76b0003f30 0x7f76b00043b0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f76d00a0410 tx=0x7f76cc010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.247 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.228+0000 7f76c37fe700 1 --2- 172.21.15.139:0/622563076 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f76b0042600 0x7f76b0044ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:48.248 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.228+0000 7f76d8331700 1 -- 172.21.15.139:0/622563076 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d0137720 con 0x7f76b0003f30 2020-02-12T14:12:48.248 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.228+0000 7f76c37fe700 1 -- 172.21.15.139:0/622563076 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f76cc0497a0 con 0x7f76b0003f30 2020-02-12T14:12:48.248 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.229+0000 7f76d60cd700 1 --2- 172.21.15.139:0/622563076 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f76b0042600 0x7f76b0044ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:48.248 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.229+0000 7f76d60cd700 1 --2- 172.21.15.139:0/622563076 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f76b0042600 0x7f76b0044ac0 crc :-1 s=READY pgs=76 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:48.249 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.232+0000 7f76d68ce700 1 --2- 172.21.15.139:0/622563076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76b0003f30 0x7f76b00043b0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f76d00a0410 tx=0x7f76cc010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.249 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.232+0000 7f76c37fe700 1 -- 172.21.15.139:0/622563076 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f76cc02ec40 con 0x7f76b0003f30 2020-02-12T14:12:48.365 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.363+0000 7f76d8331700 1 -- 172.21.15.139:0/622563076 --> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f76d0134230 con 0x7f76b0042600 2020-02-12T14:12:48.367 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.365+0000 7f76c37fe700 1 -- 172.21.15.139:0/622563076 <== mgr.4108 v2:172.21.15.139:6800/21203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+66341 (crc 0 0 0) 0x7f76c800a880 con 0x7f76b0042600 2020-02-12T14:12:48.369 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:12:48.370 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.366+0000 7f76d8331700 1 -- 172.21.15.139:0/622563076 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f76b0042600 msgr2=0x7f76b0044ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:48.370 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.366+0000 7f76d8331700 1 --2- 172.21.15.139:0/622563076 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f76b0042600 0x7f76b0044ac0 crc :-1 s=READY pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:48.370 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.366+0000 7f76d8331700 1 -- 172.21.15.139:0/622563076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76b0003f30 msgr2=0x7f76b00043b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:48.370 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.366+0000 7f76d8331700 1 --2- 172.21.15.139:0/622563076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76b0003f30 0x7f76b00043b0 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7f76d00a0410 tx=0x7f76cc010890).stop 2020-02-12T14:12:48.370 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.366+0000 7f76d68ce700 1 -- 172.21.15.139:0/622563076 reap_dead start 2020-02-12T14:12:48.370 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.366+0000 7f76d68ce700 1 -- 172.21.15.139:0/622563076 reap_dead start 2020-02-12T14:12:48.370 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.366+0000 7f76d8331700 1 -- 172.21.15.139:0/622563076 shutdown_connections 2020-02-12T14:12:48.371 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.366+0000 7f76d8331700 1 -- 172.21.15.139:0/622563076 >> 172.21.15.139:0/622563076 conn(0x7f76d0060950 msgr2=0x7f76d005e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:48.371 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.366+0000 7f76d8331700 1 -- 172.21.15.139:0/622563076 shutdown_connections 2020-02-12T14:12:48.371 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.366+0000 7f76d8331700 1 -- 172.21.15.139:0/622563076 wait complete. 2020-02-12T14:12:48.371 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2020-02-12T14:12:48.379 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2020-02-12T14:12:47.148745+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390624,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584096,"statfs":{"total":773094113280,"available":764502114304,"internally_reserved":8589934592,"allocated":1998848,"data_stored":719444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000972"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.367576+0000","last_change":"2020-02-12T14:12:39.367035+0000","last_active":"2020-02-12T14:12:39.367576+0000","last_peered":"2020-02-12T14:12:39.367576+0000","last_clean":"2020-02-12T14:12:39.367576+0000","last_became_active":"2020-02-12T14:12:39.366557+0000","last_became_peered":"2020-02-12T14:12:39.366557+0000","last_unstale":"2020-02-12T14:12:39.367576+0000","last_undegraded":"2020-02-12T14:12:39.367576+0000","last_fullsized":"2020-02-12T14:12:39.367576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_clean_scrub_stamp":"2020-02-12T14:12:38.111673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.125092+0000","last_change":"2020-02-12T14:12:33.090407+0000","last_active":"2020-02-12T14:12:39.125092+0000","last_peered":"2020-02-12T14:12:39.125092+0000","last_clean":"2020-02-12T14:12:39.125092+0000","last_became_active":"2020-02-12T14:12:33.090051+0000","last_became_peered":"2020-02-12T14:12:33.090051+0000","last_unstale":"2020-02-12T14:12:39.125092+0000","last_undegraded":"2020-02-12T14:12:39.125092+0000","last_fullsized":"2020-02-12T14:12:39.125092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_clean_scrub_stamp":"2020-02-12T14:12:32.075087+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"23'4","reported_seq":"16","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T14:12:42.150363+0000","last_change":"2020-02-12T14:12:36.313034+0000","last_active":"2020-02-12T14:12:42.150363+0000","last_peered":"2020-02-12T14:12:42.150363+0000","last_clean":"2020-02-12T14:12:42.150363+0000","last_became_active":"2020-02-12T14:12:36.312624+0000","last_became_peered":"2020-02-12T14:12:36.312624+0000","last_unstale":"2020-02-12T14:12:42.150363+0000","last_undegraded":"2020-02-12T14:12:42.150363+0000","last_fullsized":"2020-02-12T14:12:42.150363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_clean_scrub_stamp":"2020-02-12T14:12:35.089656+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.367614+0000","last_change":"2020-02-12T14:12:39.366897+0000","last_active":"2020-02-12T14:12:39.367614+0000","last_peered":"2020-02-12T14:12:39.367614+0000","last_clean":"2020-02-12T14:12:39.367614+0000","last_became_active":"2020-02-12T14:12:39.366231+0000","last_became_peered":"2020-02-12T14:12:39.366231+0000","last_unstale":"2020-02-12T14:12:39.367614+0000","last_undegraded":"2020-02-12T14:12:39.367614+0000","last_fullsized":"2020-02-12T14:12:39.367614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_clean_scrub_stamp":"2020-02-12T14:12:38.111673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.365078+0000","last_change":"2020-02-12T14:12:33.087690+0000","last_active":"2020-02-12T14:12:39.365078+0000","last_peered":"2020-02-12T14:12:39.365078+0000","last_clean":"2020-02-12T14:12:39.365078+0000","last_became_active":"2020-02-12T14:12:33.087282+0000","last_became_peered":"2020-02-12T14:12:33.087282+0000","last_unstale":"2020-02-12T14:12:39.365078+0000","last_undegraded":"2020-02-12T14:12:39.365078+0000","last_fullsized":"2020-02-12T14:12:39.365078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_clean_scrub_stamp":"2020-02-12T14:12:32.075087+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"23'7","reported_seq":"19","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T14:12:42.152596+0000","last_change":"2020-02-12T14:12:36.312904+0000","last_active":"2020-02-12T14:12:42.152596+0000","last_peered":"2020-02-12T14:12:42.152596+0000","last_clean":"2020-02-12T14:12:42.152596+0000","last_became_active":"2020-02-12T14:12:36.312463+0000","last_became_peered":"2020-02-12T14:12:36.312463+0000","last_unstale":"2020-02-12T14:12:42.152596+0000","last_undegraded":"2020-02-12T14:12:42.152596+0000","last_fullsized":"2020-02-12T14:12:42.152596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_clean_scrub_stamp":"2020-02-12T14:12:35.089656+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.130932+0000","last_change":"2020-02-12T14:12:39.130465+0000","last_active":"2020-02-12T14:12:39.130932+0000","last_peered":"2020-02-12T14:12:39.130932+0000","last_clean":"2020-02-12T14:12:39.130932+0000","last_became_active":"2020-02-12T14:12:39.129806+0000","last_became_peered":"2020-02-12T14:12:39.129806+0000","last_unstale":"2020-02-12T14:12:39.130932+0000","last_undegraded":"2020-02-12T14:12:39.130932+0000","last_fullsized":"2020-02-12T14:12:39.130932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_clean_scrub_stamp":"2020-02-12T14:12:38.111673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.128658+0000","last_change":"2020-02-12T14:12:33.087090+0000","last_active":"2020-02-12T14:12:39.128658+0000","last_peered":"2020-02-12T14:12:39.128658+0000","last_clean":"2020-02-12T14:12:39.128658+0000","last_became_active":"2020-02-12T14:12:33.086708+0000","last_became_peered":"2020-02-12T14:12:33.086708+0000","last_unstale":"2020-02-12T14:12:39.128658+0000","last_undegraded":"2020-02-12T14:12:39.128658+0000","last_fullsized":"2020-02-12T14:12:39.128658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_clean_scrub_stamp":"2020-02-12T14:12:32.075087+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"23'8","reported_seq":"20","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T14:12:42.152951+0000","last_change":"2020-02-12T14:12:36.111272+0000","last_active":"2020-02-12T14:12:42.152951+0000","last_peered":"2020-02-12T14:12:42.152951+0000","last_clean":"2020-02-12T14:12:42.152951+0000","last_became_active":"2020-02-12T14:12:36.110981+0000","last_became_peered":"2020-02-12T14:12:36.110981+0000","last_unstale":"2020-02-12T14:12:42.152951+0000","last_undegraded":"2020-02-12T14:12:42.152951+0000","last_fullsized":"2020-02-12T14:12:42.152951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_clean_scrub_stamp":"2020-02-12T14:12:35.089656+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.366748+0000","last_change":"2020-02-12T14:12:39.366400+0000","last_active":"2020-02-12T14:12:39.366748+0000","last_peered":"2020-02-12T14:12:39.366748+0000","last_clean":"2020-02-12T14:12:39.366748+0000","last_became_active":"2020-02-12T14:12:39.365812+0000","last_became_peered":"2020-02-12T14:12:39.365812+0000","last_unstale":"2020-02-12T14:12:39.366748+0000","last_undegraded":"2020-02-12T14:12:39.366748+0000","last_fullsized":"2020-02-12T14:12:39.366748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_clean_scrub_stamp":"2020-02-12T14:12:38.111673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.126064+0000","last_change":"2020-02-12T14:12:33.087771+0000","last_active":"2020-02-12T14:12:39.126064+0000","last_peered":"2020-02-12T14:12:39.126064+0000","last_clean":"2020-02-12T14:12:39.126064+0000","last_became_active":"2020-02-12T14:12:33.087185+0000","last_became_peered":"2020-02-12T14:12:33.087185+0000","last_unstale":"2020-02-12T14:12:39.126064+0000","last_undegraded":"2020-02-12T14:12:39.126064+0000","last_fullsized":"2020-02-12T14:12:39.126064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_clean_scrub_stamp":"2020-02-12T14:12:32.075087+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.365050+0000","last_change":"2020-02-12T14:12:36.111876+0000","last_active":"2020-02-12T14:12:39.365050+0000","last_peered":"2020-02-12T14:12:39.365050+0000","last_clean":"2020-02-12T14:12:39.365050+0000","last_became_active":"2020-02-12T14:12:36.111484+0000","last_became_peered":"2020-02-12T14:12:36.111484+0000","last_unstale":"2020-02-12T14:12:39.365050+0000","last_undegraded":"2020-02-12T14:12:39.365050+0000","last_fullsized":"2020-02-12T14:12:39.365050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_clean_scrub_stamp":"2020-02-12T14:12:35.089656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.293609+0000","last_change":"2020-02-12T14:12:39.293323+0000","last_active":"2020-02-12T14:12:39.293609+0000","last_peered":"2020-02-12T14:12:39.293609+0000","last_clean":"2020-02-12T14:12:39.293609+0000","last_became_active":"2020-02-12T14:12:39.292767+0000","last_became_peered":"2020-02-12T14:12:39.292767+0000","last_unstale":"2020-02-12T14:12:39.293609+0000","last_undegraded":"2020-02-12T14:12:39.293609+0000","last_fullsized":"2020-02-12T14:12:39.293609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_clean_scrub_stamp":"2020-02-12T14:12:38.111673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.291837+0000","last_change":"2020-02-12T14:12:33.088359+0000","last_active":"2020-02-12T14:12:39.291837+0000","last_peered":"2020-02-12T14:12:39.291837+0000","last_clean":"2020-02-12T14:12:39.291837+0000","last_became_active":"2020-02-12T14:12:33.088011+0000","last_became_peered":"2020-02-12T14:12:33.088011+0000","last_unstale":"2020-02-12T14:12:39.291837+0000","last_undegraded":"2020-02-12T14:12:39.291837+0000","last_fullsized":"2020-02-12T14:12:39.291837+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_clean_scrub_stamp":"2020-02-12T14:12:32.075087+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'5","reported_seq":"17","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T14:12:42.151606+0000","last_change":"2020-02-12T14:12:36.109741+0000","last_active":"2020-02-12T14:12:42.151606+0000","last_peered":"2020-02-12T14:12:42.151606+0000","last_clean":"2020-02-12T14:12:42.151606+0000","last_became_active":"2020-02-12T14:12:36.109401+0000","last_became_peered":"2020-02-12T14:12:36.109401+0000","last_unstale":"2020-02-12T14:12:42.151606+0000","last_undegraded":"2020-02-12T14:12:42.151606+0000","last_fullsized":"2020-02-12T14:12:42.151606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_clean_scrub_stamp":"2020-02-12T14:12:35.089656+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.366674+0000","last_change":"2020-02-12T14:12:39.366403+0000","last_active":"2020-02-12T14:12:39.366674+0000","last_peered":"2020-02-12T14:12:39.366674+0000","last_clean":"2020-02-12T14:12:39.366674+0000","last_became_active":"2020-02-12T14:12:39.365996+0000","last_became_peered":"2020-02-12T14:12:39.365996+0000","last_unstale":"2020-02-12T14:12:39.366674+0000","last_undegraded":"2020-02-12T14:12:39.366674+0000","last_fullsized":"2020-02-12T14:12:39.366674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_clean_scrub_stamp":"2020-02-12T14:12:38.111673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.124168+0000","last_change":"2020-02-12T14:12:33.088517+0000","last_active":"2020-02-12T14:12:39.124168+0000","last_peered":"2020-02-12T14:12:39.124168+0000","last_clean":"2020-02-12T14:12:39.124168+0000","last_became_active":"2020-02-12T14:12:33.087571+0000","last_became_peered":"2020-02-12T14:12:33.087571+0000","last_unstale":"2020-02-12T14:12:39.124168+0000","last_undegraded":"2020-02-12T14:12:39.124168+0000","last_fullsized":"2020-02-12T14:12:39.124168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_clean_scrub_stamp":"2020-02-12T14:12:32.075087+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"23'1","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T14:12:39.451857+0000","last_change":"2020-02-12T14:12:36.110186+0000","last_active":"2020-02-12T14:12:39.451857+0000","last_peered":"2020-02-12T14:12:39.451857+0000","last_clean":"2020-02-12T14:12:39.451857+0000","last_became_active":"2020-02-12T14:12:36.109879+0000","last_became_peered":"2020-02-12T14:12:36.109879+0000","last_unstale":"2020-02-12T14:12:39.451857+0000","last_undegraded":"2020-02-12T14:12:39.451857+0000","last_fullsized":"2020-02-12T14:12:39.451857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_clean_scrub_stamp":"2020-02-12T14:12:35.089656+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.130930+0000","last_change":"2020-02-12T14:12:39.130405+0000","last_active":"2020-02-12T14:12:39.130930+0000","last_peered":"2020-02-12T14:12:39.130930+0000","last_clean":"2020-02-12T14:12:39.130930+0000","last_became_active":"2020-02-12T14:12:39.129801+0000","last_became_peered":"2020-02-12T14:12:39.129801+0000","last_unstale":"2020-02-12T14:12:39.130930+0000","last_undegraded":"2020-02-12T14:12:39.130930+0000","last_fullsized":"2020-02-12T14:12:39.130930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_clean_scrub_stamp":"2020-02-12T14:12:38.111673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.124204+0000","last_change":"2020-02-12T14:12:33.089828+0000","last_active":"2020-02-12T14:12:39.124204+0000","last_peered":"2020-02-12T14:12:39.124204+0000","last_clean":"2020-02-12T14:12:39.124204+0000","last_became_active":"2020-02-12T14:12:33.089559+0000","last_became_peered":"2020-02-12T14:12:33.089559+0000","last_unstale":"2020-02-12T14:12:39.124204+0000","last_undegraded":"2020-02-12T14:12:39.124204+0000","last_fullsized":"2020-02-12T14:12:39.124204+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_clean_scrub_stamp":"2020-02-12T14:12:32.075087+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"23'6","reported_seq":"18","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T14:12:42.153231+0000","last_change":"2020-02-12T14:12:36.110514+0000","last_active":"2020-02-12T14:12:42.153231+0000","last_peered":"2020-02-12T14:12:42.153231+0000","last_clean":"2020-02-12T14:12:42.153231+0000","last_became_active":"2020-02-12T14:12:36.110189+0000","last_became_peered":"2020-02-12T14:12:36.110189+0000","last_unstale":"2020-02-12T14:12:42.153231+0000","last_undegraded":"2020-02-12T14:12:42.153231+0000","last_fullsized":"2020-02-12T14:12:42.153231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_clean_scrub_stamp":"2020-02-12T14:12:35.089656+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.131359+0000","last_change":"2020-02-12T14:12:39.131025+0000","last_active":"2020-02-12T14:12:39.131359+0000","last_peered":"2020-02-12T14:12:39.131359+0000","last_clean":"2020-02-12T14:12:39.131359+0000","last_became_active":"2020-02-12T14:12:39.130493+0000","last_became_peered":"2020-02-12T14:12:39.130493+0000","last_unstale":"2020-02-12T14:12:39.131359+0000","last_undegraded":"2020-02-12T14:12:39.131359+0000","last_fullsized":"2020-02-12T14:12:39.131359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_clean_scrub_stamp":"2020-02-12T14:12:38.111673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.291863+0000","last_change":"2020-02-12T14:12:33.089276+0000","last_active":"2020-02-12T14:12:39.291863+0000","last_peered":"2020-02-12T14:12:39.291863+0000","last_clean":"2020-02-12T14:12:39.291863+0000","last_became_active":"2020-02-12T14:12:33.088929+0000","last_became_peered":"2020-02-12T14:12:33.088929+0000","last_unstale":"2020-02-12T14:12:39.291863+0000","last_undegraded":"2020-02-12T14:12:39.291863+0000","last_fullsized":"2020-02-12T14:12:39.291863+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_clean_scrub_stamp":"2020-02-12T14:12:32.075087+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"23'8","reported_seq":"20","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T14:12:42.150952+0000","last_change":"2020-02-12T14:12:36.111835+0000","last_active":"2020-02-12T14:12:42.150952+0000","last_peered":"2020-02-12T14:12:42.150952+0000","last_clean":"2020-02-12T14:12:42.150952+0000","last_became_active":"2020-02-12T14:12:36.111447+0000","last_became_peered":"2020-02-12T14:12:36.111447+0000","last_unstale":"2020-02-12T14:12:42.150952+0000","last_undegraded":"2020-02-12T14:12:42.150952+0000","last_fullsized":"2020-02-12T14:12:42.150952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_clean_scrub_stamp":"2020-02-12T14:12:35.089656+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":90885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":89925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":89393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":90119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":89519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":90885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}]}} 2020-02-12T14:12:48.382 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-02-12T14:12:48.487 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.485+0000 7f84f4014700 1 Processor -- start 2020-02-12T14:12:48.487 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.485+0000 7f84f4014700 1 -- start start 2020-02-12T14:12:48.490 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.486+0000 7f84f4014700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84ec0a3f40 0x7f84ec134df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:48.491 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.486+0000 7f84f4014700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f84ec0a24a0 0x7f84ec12e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:48.491 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.486+0000 7f84f4014700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84ec1359e0 con 0x7f84ec135250 2020-02-12T14:12:48.491 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.486+0000 7f84f4014700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84ec135c80 con 0x7f84ec0a24a0 2020-02-12T14:12:48.492 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.486+0000 7f84f4014700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec0a18f0 con 0x7f84ec0a3f40 2020-02-12T14:12:48.492 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.486+0000 7f84f25b1700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f84ec0a24a0 0x7f84ec12e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:48.492 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.486+0000 7f84f25b1700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f84ec0a24a0 0x7f84ec12e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47068/0 (socket says 172.21.15.139:47068) 2020-02-12T14:12:48.492 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.486+0000 7f84f25b1700 1 -- 172.21.15.139:0/1992268136 learned_addr learned my addr 172.21.15.139:0/1992268136 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:48.492 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.486+0000 7f84f1db0700 1 --2- 172.21.15.139:0/1992268136 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84ec0a3f40 0x7f84ec134df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:48.493 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.486+0000 7f84f25b1700 1 -- 172.21.15.139:0/1992268136 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84ec0a3f40 msgr2=0x7f84ec134df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:48.493 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.486+0000 7f84f25b1700 1 --2- 172.21.15.139:0/1992268136 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84ec0a3f40 0x7f84ec134df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:48.493 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.486+0000 7f84f25b1700 1 -- 172.21.15.139:0/1992268136 >> v1:172.21.15.72:6789/0 conn(0x7f84ec135250 legacy=0x7f84ec0a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:48.493 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.486+0000 7f84f25b1700 1 -- 172.21.15.139:0/1992268136 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ec1356b0 con 0x7f84ec0a24a0 2020-02-12T14:12:48.493 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.486+0000 7f84f25b1700 1 --2- 172.21.15.139:0/1992268136 >> v2:172.21.15.139:3300/0 conn(0x7f84ec0a24a0 0x7f84ec12e6b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f84e40032b0 tx=0x7f84e4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.494 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.486+0000 7f84f25b1700 1 --2- 172.21.15.139:0/1992268136 >> v2:172.21.15.139:3300/0 conn(0x7f84ec0a24a0 0x7f84ec12e6b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f84e40032b0 tx=0x7f84e4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.494 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.486+0000 7f84f25b1700 1 --2- 172.21.15.139:0/1992268136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84ec0a24a0 0x7f84ec12e6b0 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7f84e40032b0 tx=0x7f84e4008c60).ready entity=mon.1 client_cookie=c046bc7cc6e98734 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:48.494 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.486+0000 7f84f25b1700 1 --2- 172.21.15.139:0/1992268136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84ec0a24a0 0x7f84ec12e6b0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f84e40032b0 tx=0x7f84e4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.494 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.487+0000 7f84f0dae700 1 -- 172.21.15.139:0/1992268136 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84e400a160 con 0x7f84ec0a24a0 2020-02-12T14:12:48.494 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.487+0000 7f84f25b1700 1 --2- 172.21.15.139:0/1992268136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84ec0a24a0 0x7f84ec12e6b0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f84e40032b0 tx=0x7f84e4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.494 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.487+0000 7f84f25b1700 1 --2- 172.21.15.139:0/1992268136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84ec0a24a0 0x7f84ec12e6b0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f84e40032b0 tx=0x7f84e4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.494 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.487+0000 7f84f0dae700 1 -- 172.21.15.139:0/1992268136 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e400a2c0 con 0x7f84ec0a24a0 2020-02-12T14:12:48.495 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.487+0000 7f84f0dae700 1 -- 172.21.15.139:0/1992268136 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84e400a6a0 con 0x7f84ec0a24a0 2020-02-12T14:12:48.495 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.487+0000 7f84f4014700 1 -- 172.21.15.139:0/1992268136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84ec0a24a0 msgr2=0x7f84ec12e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:48.495 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.487+0000 7f84f4014700 1 --2- 172.21.15.139:0/1992268136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84ec0a24a0 0x7f84ec12e6b0 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7f84e40032b0 tx=0x7f84e4008c60).stop 2020-02-12T14:12:48.495 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.487+0000 7f84f4014700 1 -- 172.21.15.139:0/1992268136 shutdown_connections 2020-02-12T14:12:48.495 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.487+0000 7f84f4014700 1 --2- 172.21.15.139:0/1992268136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84ec0a24a0 0x7f84ec12e6b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:48.495 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.487+0000 7f84f4014700 1 --2- 172.21.15.139:0/1992268136 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84ec0a3f40 0x7f84ec134df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:48.496 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.487+0000 7f84f4014700 1 -- 172.21.15.139:0/1992268136 >> 172.21.15.139:0/1992268136 conn(0x7f84ec060950 msgr2=0x7f84ec09d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:48.496 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.487+0000 7f84f4014700 1 -- 172.21.15.139:0/1992268136 shutdown_connections 2020-02-12T14:12:48.496 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.487+0000 7f84f4014700 1 -- 172.21.15.139:0/1992268136 wait complete. 2020-02-12T14:12:48.496 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.488+0000 7f84f4014700 1 Processor -- start 2020-02-12T14:12:48.496 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.488+0000 7f84f4014700 1 -- start start 2020-02-12T14:12:48.501 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.489+0000 7f84f4014700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f84ec0a3f40 0x7f84ec143530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:48.501 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.489+0000 7f84f4014700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84ec1478c0 con 0x7f84ec135250 2020-02-12T14:12:48.501 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.489+0000 7f84f4014700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84ec12bd20 con 0x7f84ec0a24a0 2020-02-12T14:12:48.502 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.489+0000 7f84f4014700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84ec0a0410 con 0x7f84ec0a3f40 2020-02-12T14:12:48.502 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.489+0000 7f84f1db0700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f84ec0a24a0 0x7f84ec134980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35708/0 (socket says 172.21.15.139:35708) 2020-02-12T14:12:48.502 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.489+0000 7f84f1db0700 1 -- 172.21.15.139:0/3150569925 learned_addr learned my addr 172.21.15.139:0/3150569925 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:48.502 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.489+0000 7f84f15af700 1 --2- 172.21.15.139:0/3150569925 >> v2:172.21.15.72:3300/0 conn(0x7f84ec0a3f40 0x7f84ec143530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:48.502 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.489+0000 7f84daffd700 1 -- 172.21.15.139:0/3150569925 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2201027386 0 0) 0x7f84ec12bd20 con 0x7f84ec0a24a0 2020-02-12T14:12:48.502 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.489+0000 7f84daffd700 1 -- 172.21.15.139:0/3150569925 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84cc002fe0 con 0x7f84ec0a24a0 2020-02-12T14:12:48.503 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.489+0000 7f84daffd700 1 -- 172.21.15.139:0/3150569925 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4238562798 0 0) 0x7f84cc002fe0 con 0x7f84ec0a24a0 2020-02-12T14:12:48.503 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.489+0000 7f84daffd700 1 -- 172.21.15.139:0/3150569925 --> v1:172.21.15.139:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f84ec12bd20 con 0x7f84ec0a24a0 2020-02-12T14:12:48.503 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.489+0000 7f84daffd700 1 -- 172.21.15.139:0/3150569925 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7f84dc001490 con 0x7f84ec0a24a0 2020-02-12T14:12:48.503 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.489+0000 7f84f15af700 1 -- 172.21.15.139:0/3150569925 >> v1:172.21.15.139:6789/0 conn(0x7f84ec0a24a0 legacy=0x7f84ec134980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:48.503 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.489+0000 7f84f15af700 1 -- 172.21.15.139:0/3150569925 >> v1:172.21.15.72:6789/0 conn(0x7f84ec135250 legacy=0x7f84ec12b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:48.503 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.489+0000 7f84f15af700 1 -- 172.21.15.139:0/3150569925 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ec146ee0 con 0x7f84ec0a3f40 2020-02-12T14:12:48.503 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.489+0000 7f84f15af700 1 --2- 172.21.15.139:0/3150569925 >> v2:172.21.15.72:3300/0 conn(0x7f84ec0a3f40 0x7f84ec143530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f84e80013f0 tx=0x7f84e8010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.504 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.489+0000 7f84f15af700 1 --2- 172.21.15.139:0/3150569925 >> v2:172.21.15.72:3300/0 conn(0x7f84ec0a3f40 0x7f84ec143530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f84e80013f0 tx=0x7f84e8010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.504 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.489+0000 7f84f15af700 1 --2- 172.21.15.139:0/3150569925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84ec0a3f40 0x7f84ec143530 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f84e80013f0 tx=0x7f84e8010890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:48.504 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.489+0000 7f84f15af700 1 --2- 172.21.15.139:0/3150569925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84ec0a3f40 0x7f84ec143530 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f84e80013f0 tx=0x7f84e8010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.504 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.489+0000 7f84daffd700 1 -- 172.21.15.139:0/3150569925 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84e8001ea0 con 0x7f84ec0a3f40 2020-02-12T14:12:48.504 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.489+0000 7f84f15af700 1 --2- 172.21.15.139:0/3150569925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84ec0a3f40 0x7f84ec143530 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f84e80013f0 tx=0x7f84e8010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.504 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.489+0000 7f84daffd700 1 -- 172.21.15.139:0/3150569925 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e800c9f0 con 0x7f84ec0a3f40 2020-02-12T14:12:48.504 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.489+0000 7f84f15af700 1 --2- 172.21.15.139:0/3150569925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84ec0a3f40 0x7f84ec143530 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f84e80013f0 tx=0x7f84e8010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.505 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.489+0000 7f84f4014700 1 -- 172.21.15.139:0/3150569925 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ec147180 con 0x7f84ec0a3f40 2020-02-12T14:12:48.505 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.489+0000 7f84daffd700 1 -- 172.21.15.139:0/3150569925 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84e800cdd0 con 0x7f84ec0a3f40 2020-02-12T14:12:48.505 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.490+0000 7f84f4014700 1 -- 172.21.15.139:0/3150569925 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84ec138e90 con 0x7f84ec0a3f40 2020-02-12T14:12:48.505 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.490+0000 7f84f15af700 1 --2- 172.21.15.139:0/3150569925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84ec0a3f40 0x7f84ec143530 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f84e80013f0 tx=0x7f84e8010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.505 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.490+0000 7f84daffd700 1 -- 172.21.15.139:0/3150569925 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f84e80064e0 con 0x7f84ec0a3f40 2020-02-12T14:12:48.505 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.490+0000 7f84f15af700 1 --2- 172.21.15.139:0/3150569925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84ec0a3f40 0x7f84ec143530 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f84e80013f0 tx=0x7f84e8010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.505 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.491+0000 7f84daffd700 1 --2- 172.21.15.139:0/3150569925 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f84cc03a180 0x7f84cc03c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:48.506 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.491+0000 7f84f4014700 1 -- 172.21.15.139:0/3150569925 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84ec12bac0 con 0x7f84ec0a3f40 2020-02-12T14:12:48.506 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.491+0000 7f84daffd700 1 -- 172.21.15.139:0/3150569925 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f84e80491f0 con 0x7f84ec0a3f40 2020-02-12T14:12:48.506 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.491+0000 7f84f1db0700 1 --2- 172.21.15.139:0/3150569925 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f84cc03a180 0x7f84cc03c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:48.506 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.491+0000 7f84f1db0700 1 --2- 172.21.15.139:0/3150569925 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f84cc03a180 0x7f84cc03c640 crc :-1 s=READY pgs=77 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:48.506 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.495+0000 7f84f15af700 1 --2- 172.21.15.139:0/3150569925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84ec0a3f40 0x7f84ec143530 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f84e80013f0 tx=0x7f84e8010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.506 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.495+0000 7f84daffd700 1 -- 172.21.15.139:0/3150569925 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f84e802e740 con 0x7f84ec0a3f40 2020-02-12T14:12:48.626 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.624+0000 7f84f4014700 1 -- 172.21.15.139:0/3150569925 --> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f84ec1475e0 con 0x7f84cc03a180 2020-02-12T14:12:48.630 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.626+0000 7f84daffd700 1 -- 172.21.15.139:0/3150569925 <== mgr.4108 v2:172.21.15.139:6800/21203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+66341 (crc 0 0 0) 0x7f84ec1475e0 con 0x7f84cc03a180 2020-02-12T14:12:48.631 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.627+0000 7f84f4014700 1 -- 172.21.15.139:0/3150569925 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f84cc03a180 msgr2=0x7f84cc03c640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:48.631 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.627+0000 7f84f4014700 1 --2- 172.21.15.139:0/3150569925 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f84cc03a180 0x7f84cc03c640 crc :-1 s=READY pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:48.631 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.627+0000 7f84f4014700 1 -- 172.21.15.139:0/3150569925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84ec0a3f40 msgr2=0x7f84ec143530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:48.631 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.627+0000 7f84f4014700 1 --2- 172.21.15.139:0/3150569925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84ec0a3f40 0x7f84ec143530 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f84e80013f0 tx=0x7f84e8010890).stop 2020-02-12T14:12:48.631 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.627+0000 7f84f4014700 1 -- 172.21.15.139:0/3150569925 shutdown_connections 2020-02-12T14:12:48.631 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.627+0000 7f84f4014700 1 --2- 172.21.15.139:0/3150569925 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f84cc03a180 0x7f84cc03c640 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:48.631 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.627+0000 7f84f4014700 1 --2- 172.21.15.139:0/3150569925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84ec0a3f40 0x7f84ec143530 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:48.632 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.627+0000 7f84f4014700 1 -- 172.21.15.139:0/3150569925 >> 172.21.15.139:0/3150569925 conn(0x7f84ec060950 msgr2=0x7f84ec05e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:48.632 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.627+0000 7f84f4014700 1 -- 172.21.15.139:0/3150569925 shutdown_connections 2020-02-12T14:12:48.632 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.627+0000 7f84f4014700 1 -- 172.21.15.139:0/3150569925 wait complete. 2020-02-12T14:12:48.632 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2020-02-12T14:12:48.632 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:12:48.640 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2020-02-12T14:12:47.148745+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390624,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584096,"statfs":{"total":773094113280,"available":764502114304,"internally_reserved":8589934592,"allocated":1998848,"data_stored":719444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000972"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.367576+0000","last_change":"2020-02-12T14:12:39.367035+0000","last_active":"2020-02-12T14:12:39.367576+0000","last_peered":"2020-02-12T14:12:39.367576+0000","last_clean":"2020-02-12T14:12:39.367576+0000","last_became_active":"2020-02-12T14:12:39.366557+0000","last_became_peered":"2020-02-12T14:12:39.366557+0000","last_unstale":"2020-02-12T14:12:39.367576+0000","last_undegraded":"2020-02-12T14:12:39.367576+0000","last_fullsized":"2020-02-12T14:12:39.367576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_clean_scrub_stamp":"2020-02-12T14:12:38.111673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.125092+0000","last_change":"2020-02-12T14:12:33.090407+0000","last_active":"2020-02-12T14:12:39.125092+0000","last_peered":"2020-02-12T14:12:39.125092+0000","last_clean":"2020-02-12T14:12:39.125092+0000","last_became_active":"2020-02-12T14:12:33.090051+0000","last_became_peered":"2020-02-12T14:12:33.090051+0000","last_unstale":"2020-02-12T14:12:39.125092+0000","last_undegraded":"2020-02-12T14:12:39.125092+0000","last_fullsized":"2020-02-12T14:12:39.125092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_clean_scrub_stamp":"2020-02-12T14:12:32.075087+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"23'4","reported_seq":"16","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T14:12:42.150363+0000","last_change":"2020-02-12T14:12:36.313034+0000","last_active":"2020-02-12T14:12:42.150363+0000","last_peered":"2020-02-12T14:12:42.150363+0000","last_clean":"2020-02-12T14:12:42.150363+0000","last_became_active":"2020-02-12T14:12:36.312624+0000","last_became_peered":"2020-02-12T14:12:36.312624+0000","last_unstale":"2020-02-12T14:12:42.150363+0000","last_undegraded":"2020-02-12T14:12:42.150363+0000","last_fullsized":"2020-02-12T14:12:42.150363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_clean_scrub_stamp":"2020-02-12T14:12:35.089656+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.367614+0000","last_change":"2020-02-12T14:12:39.366897+0000","last_active":"2020-02-12T14:12:39.367614+0000","last_peered":"2020-02-12T14:12:39.367614+0000","last_clean":"2020-02-12T14:12:39.367614+0000","last_became_active":"2020-02-12T14:12:39.366231+0000","last_became_peered":"2020-02-12T14:12:39.366231+0000","last_unstale":"2020-02-12T14:12:39.367614+0000","last_undegraded":"2020-02-12T14:12:39.367614+0000","last_fullsized":"2020-02-12T14:12:39.367614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_clean_scrub_stamp":"2020-02-12T14:12:38.111673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.365078+0000","last_change":"2020-02-12T14:12:33.087690+0000","last_active":"2020-02-12T14:12:39.365078+0000","last_peered":"2020-02-12T14:12:39.365078+0000","last_clean":"2020-02-12T14:12:39.365078+0000","last_became_active":"2020-02-12T14:12:33.087282+0000","last_became_peered":"2020-02-12T14:12:33.087282+0000","last_unstale":"2020-02-12T14:12:39.365078+0000","last_undegraded":"2020-02-12T14:12:39.365078+0000","last_fullsized":"2020-02-12T14:12:39.365078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_clean_scrub_stamp":"2020-02-12T14:12:32.075087+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"23'7","reported_seq":"19","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T14:12:42.152596+0000","last_change":"2020-02-12T14:12:36.312904+0000","last_active":"2020-02-12T14:12:42.152596+0000","last_peered":"2020-02-12T14:12:42.152596+0000","last_clean":"2020-02-12T14:12:42.152596+0000","last_became_active":"2020-02-12T14:12:36.312463+0000","last_became_peered":"2020-02-12T14:12:36.312463+0000","last_unstale":"2020-02-12T14:12:42.152596+0000","last_undegraded":"2020-02-12T14:12:42.152596+0000","last_fullsized":"2020-02-12T14:12:42.152596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_clean_scrub_stamp":"2020-02-12T14:12:35.089656+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.130932+0000","last_change":"2020-02-12T14:12:39.130465+0000","last_active":"2020-02-12T14:12:39.130932+0000","last_peered":"2020-02-12T14:12:39.130932+0000","last_clean":"2020-02-12T14:12:39.130932+0000","last_became_active":"2020-02-12T14:12:39.129806+0000","last_became_peered":"2020-02-12T14:12:39.129806+0000","last_unstale":"2020-02-12T14:12:39.130932+0000","last_undegraded":"2020-02-12T14:12:39.130932+0000","last_fullsized":"2020-02-12T14:12:39.130932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_clean_scrub_stamp":"2020-02-12T14:12:38.111673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.128658+0000","last_change":"2020-02-12T14:12:33.087090+0000","last_active":"2020-02-12T14:12:39.128658+0000","last_peered":"2020-02-12T14:12:39.128658+0000","last_clean":"2020-02-12T14:12:39.128658+0000","last_became_active":"2020-02-12T14:12:33.086708+0000","last_became_peered":"2020-02-12T14:12:33.086708+0000","last_unstale":"2020-02-12T14:12:39.128658+0000","last_undegraded":"2020-02-12T14:12:39.128658+0000","last_fullsized":"2020-02-12T14:12:39.128658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_clean_scrub_stamp":"2020-02-12T14:12:32.075087+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"23'8","reported_seq":"20","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T14:12:42.152951+0000","last_change":"2020-02-12T14:12:36.111272+0000","last_active":"2020-02-12T14:12:42.152951+0000","last_peered":"2020-02-12T14:12:42.152951+0000","last_clean":"2020-02-12T14:12:42.152951+0000","last_became_active":"2020-02-12T14:12:36.110981+0000","last_became_peered":"2020-02-12T14:12:36.110981+0000","last_unstale":"2020-02-12T14:12:42.152951+0000","last_undegraded":"2020-02-12T14:12:42.152951+0000","last_fullsized":"2020-02-12T14:12:42.152951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_clean_scrub_stamp":"2020-02-12T14:12:35.089656+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.366748+0000","last_change":"2020-02-12T14:12:39.366400+0000","last_active":"2020-02-12T14:12:39.366748+0000","last_peered":"2020-02-12T14:12:39.366748+0000","last_clean":"2020-02-12T14:12:39.366748+0000","last_became_active":"2020-02-12T14:12:39.365812+0000","last_became_peered":"2020-02-12T14:12:39.365812+0000","last_unstale":"2020-02-12T14:12:39.366748+0000","last_undegraded":"2020-02-12T14:12:39.366748+0000","last_fullsized":"2020-02-12T14:12:39.366748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_clean_scrub_stamp":"2020-02-12T14:12:38.111673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.126064+0000","last_change":"2020-02-12T14:12:33.087771+0000","last_active":"2020-02-12T14:12:39.126064+0000","last_peered":"2020-02-12T14:12:39.126064+0000","last_clean":"2020-02-12T14:12:39.126064+0000","last_became_active":"2020-02-12T14:12:33.087185+0000","last_became_peered":"2020-02-12T14:12:33.087185+0000","last_unstale":"2020-02-12T14:12:39.126064+0000","last_undegraded":"2020-02-12T14:12:39.126064+0000","last_fullsized":"2020-02-12T14:12:39.126064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_clean_scrub_stamp":"2020-02-12T14:12:32.075087+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.365050+0000","last_change":"2020-02-12T14:12:36.111876+0000","last_active":"2020-02-12T14:12:39.365050+0000","last_peered":"2020-02-12T14:12:39.365050+0000","last_clean":"2020-02-12T14:12:39.365050+0000","last_became_active":"2020-02-12T14:12:36.111484+0000","last_became_peered":"2020-02-12T14:12:36.111484+0000","last_unstale":"2020-02-12T14:12:39.365050+0000","last_undegraded":"2020-02-12T14:12:39.365050+0000","last_fullsized":"2020-02-12T14:12:39.365050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_clean_scrub_stamp":"2020-02-12T14:12:35.089656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.293609+0000","last_change":"2020-02-12T14:12:39.293323+0000","last_active":"2020-02-12T14:12:39.293609+0000","last_peered":"2020-02-12T14:12:39.293609+0000","last_clean":"2020-02-12T14:12:39.293609+0000","last_became_active":"2020-02-12T14:12:39.292767+0000","last_became_peered":"2020-02-12T14:12:39.292767+0000","last_unstale":"2020-02-12T14:12:39.293609+0000","last_undegraded":"2020-02-12T14:12:39.293609+0000","last_fullsized":"2020-02-12T14:12:39.293609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_clean_scrub_stamp":"2020-02-12T14:12:38.111673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.291837+0000","last_change":"2020-02-12T14:12:33.088359+0000","last_active":"2020-02-12T14:12:39.291837+0000","last_peered":"2020-02-12T14:12:39.291837+0000","last_clean":"2020-02-12T14:12:39.291837+0000","last_became_active":"2020-02-12T14:12:33.088011+0000","last_became_peered":"2020-02-12T14:12:33.088011+0000","last_unstale":"2020-02-12T14:12:39.291837+0000","last_undegraded":"2020-02-12T14:12:39.291837+0000","last_fullsized":"2020-02-12T14:12:39.291837+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_clean_scrub_stamp":"2020-02-12T14:12:32.075087+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'5","reported_seq":"17","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T14:12:42.151606+0000","last_change":"2020-02-12T14:12:36.109741+0000","last_active":"2020-02-12T14:12:42.151606+0000","last_peered":"2020-02-12T14:12:42.151606+0000","last_clean":"2020-02-12T14:12:42.151606+0000","last_became_active":"2020-02-12T14:12:36.109401+0000","last_became_peered":"2020-02-12T14:12:36.109401+0000","last_unstale":"2020-02-12T14:12:42.151606+0000","last_undegraded":"2020-02-12T14:12:42.151606+0000","last_fullsized":"2020-02-12T14:12:42.151606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_clean_scrub_stamp":"2020-02-12T14:12:35.089656+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.366674+0000","last_change":"2020-02-12T14:12:39.366403+0000","last_active":"2020-02-12T14:12:39.366674+0000","last_peered":"2020-02-12T14:12:39.366674+0000","last_clean":"2020-02-12T14:12:39.366674+0000","last_became_active":"2020-02-12T14:12:39.365996+0000","last_became_peered":"2020-02-12T14:12:39.365996+0000","last_unstale":"2020-02-12T14:12:39.366674+0000","last_undegraded":"2020-02-12T14:12:39.366674+0000","last_fullsized":"2020-02-12T14:12:39.366674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_clean_scrub_stamp":"2020-02-12T14:12:38.111673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.124168+0000","last_change":"2020-02-12T14:12:33.088517+0000","last_active":"2020-02-12T14:12:39.124168+0000","last_peered":"2020-02-12T14:12:39.124168+0000","last_clean":"2020-02-12T14:12:39.124168+0000","last_became_active":"2020-02-12T14:12:33.087571+0000","last_became_peered":"2020-02-12T14:12:33.087571+0000","last_unstale":"2020-02-12T14:12:39.124168+0000","last_undegraded":"2020-02-12T14:12:39.124168+0000","last_fullsized":"2020-02-12T14:12:39.124168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_clean_scrub_stamp":"2020-02-12T14:12:32.075087+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"23'1","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T14:12:39.451857+0000","last_change":"2020-02-12T14:12:36.110186+0000","last_active":"2020-02-12T14:12:39.451857+0000","last_peered":"2020-02-12T14:12:39.451857+0000","last_clean":"2020-02-12T14:12:39.451857+0000","last_became_active":"2020-02-12T14:12:36.109879+0000","last_became_peered":"2020-02-12T14:12:36.109879+0000","last_unstale":"2020-02-12T14:12:39.451857+0000","last_undegraded":"2020-02-12T14:12:39.451857+0000","last_fullsized":"2020-02-12T14:12:39.451857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_clean_scrub_stamp":"2020-02-12T14:12:35.089656+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.130930+0000","last_change":"2020-02-12T14:12:39.130405+0000","last_active":"2020-02-12T14:12:39.130930+0000","last_peered":"2020-02-12T14:12:39.130930+0000","last_clean":"2020-02-12T14:12:39.130930+0000","last_became_active":"2020-02-12T14:12:39.129801+0000","last_became_peered":"2020-02-12T14:12:39.129801+0000","last_unstale":"2020-02-12T14:12:39.130930+0000","last_undegraded":"2020-02-12T14:12:39.130930+0000","last_fullsized":"2020-02-12T14:12:39.130930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_clean_scrub_stamp":"2020-02-12T14:12:38.111673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.124204+0000","last_change":"2020-02-12T14:12:33.089828+0000","last_active":"2020-02-12T14:12:39.124204+0000","last_peered":"2020-02-12T14:12:39.124204+0000","last_clean":"2020-02-12T14:12:39.124204+0000","last_became_active":"2020-02-12T14:12:33.089559+0000","last_became_peered":"2020-02-12T14:12:33.089559+0000","last_unstale":"2020-02-12T14:12:39.124204+0000","last_undegraded":"2020-02-12T14:12:39.124204+0000","last_fullsized":"2020-02-12T14:12:39.124204+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_clean_scrub_stamp":"2020-02-12T14:12:32.075087+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"23'6","reported_seq":"18","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T14:12:42.153231+0000","last_change":"2020-02-12T14:12:36.110514+0000","last_active":"2020-02-12T14:12:42.153231+0000","last_peered":"2020-02-12T14:12:42.153231+0000","last_clean":"2020-02-12T14:12:42.153231+0000","last_became_active":"2020-02-12T14:12:36.110189+0000","last_became_peered":"2020-02-12T14:12:36.110189+0000","last_unstale":"2020-02-12T14:12:42.153231+0000","last_undegraded":"2020-02-12T14:12:42.153231+0000","last_fullsized":"2020-02-12T14:12:42.153231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_clean_scrub_stamp":"2020-02-12T14:12:35.089656+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.131359+0000","last_change":"2020-02-12T14:12:39.131025+0000","last_active":"2020-02-12T14:12:39.131359+0000","last_peered":"2020-02-12T14:12:39.131359+0000","last_clean":"2020-02-12T14:12:39.131359+0000","last_became_active":"2020-02-12T14:12:39.130493+0000","last_became_peered":"2020-02-12T14:12:39.130493+0000","last_unstale":"2020-02-12T14:12:39.131359+0000","last_undegraded":"2020-02-12T14:12:39.131359+0000","last_fullsized":"2020-02-12T14:12:39.131359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:38.111673+0000","last_clean_scrub_stamp":"2020-02-12T14:12:38.111673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-12T14:12:39.291863+0000","last_change":"2020-02-12T14:12:33.089276+0000","last_active":"2020-02-12T14:12:39.291863+0000","last_peered":"2020-02-12T14:12:39.291863+0000","last_clean":"2020-02-12T14:12:39.291863+0000","last_became_active":"2020-02-12T14:12:33.088929+0000","last_became_peered":"2020-02-12T14:12:33.088929+0000","last_unstale":"2020-02-12T14:12:39.291863+0000","last_undegraded":"2020-02-12T14:12:39.291863+0000","last_fullsized":"2020-02-12T14:12:39.291863+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:32.075087+0000","last_clean_scrub_stamp":"2020-02-12T14:12:32.075087+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"23'8","reported_seq":"20","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T14:12:42.150952+0000","last_change":"2020-02-12T14:12:36.111835+0000","last_active":"2020-02-12T14:12:42.150952+0000","last_peered":"2020-02-12T14:12:42.150952+0000","last_clean":"2020-02-12T14:12:42.150952+0000","last_became_active":"2020-02-12T14:12:36.111447+0000","last_became_peered":"2020-02-12T14:12:36.111447+0000","last_unstale":"2020-02-12T14:12:42.150952+0000","last_undegraded":"2020-02-12T14:12:42.150952+0000","last_fullsized":"2020-02-12T14:12:42.150952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T14:12:35.089656+0000","last_clean_scrub_stamp":"2020-02-12T14:12:35.089656+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":90885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":89925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":89393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":90119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":89519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":90885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}]}} 2020-02-12T14:12:48.642 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-02-12T14:12:48.643 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-02-12T14:12:48.643 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-02-12T14:12:48.643 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early health --format=json 2020-02-12T14:12:48.747 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.745+0000 7f225cacc700 1 Processor -- start 2020-02-12T14:12:48.853 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.745+0000 7f225cacc700 1 -- start start 2020-02-12T14:12:48.860 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.746+0000 7f225cacc700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f22580a3f40 0x7f2258134df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:48.861 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.746+0000 7f225cacc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f22580a24a0 0x7f225812e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:48.861 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.746+0000 7f225cacc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22581359e0 con 0x7f2258135250 2020-02-12T14:12:48.861 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.746+0000 7f225cacc700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2258135c80 con 0x7f22580a24a0 2020-02-12T14:12:48.861 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.746+0000 7f225cacc700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22580a18f0 con 0x7f22580a3f40 2020-02-12T14:12:48.861 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.746+0000 7f225659c700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f22580a3f40 0x7f2258134df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:48.861 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.746+0000 7f225659c700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f22580a3f40 0x7f2258134df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47078/0 (socket says 172.21.15.139:47078) 2020-02-12T14:12:48.862 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.746+0000 7f225659c700 1 -- 172.21.15.139:0/2163593521 learned_addr learned my addr 172.21.15.139:0/2163593521 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:48.862 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.746+0000 7f2256d9d700 1 --2- 172.21.15.139:0/2163593521 >> v2:172.21.15.72:3300/0 conn(0x7f22580a24a0 0x7f225812e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:48.862 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.746+0000 7f225659c700 1 -- 172.21.15.139:0/2163593521 >> v2:172.21.15.72:3300/0 conn(0x7f22580a24a0 msgr2=0x7f225812e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:48.862 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.746+0000 7f225659c700 1 --2- 172.21.15.139:0/2163593521 >> v2:172.21.15.72:3300/0 conn(0x7f22580a24a0 0x7f225812e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:48.862 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.746+0000 7f225659c700 1 -- 172.21.15.139:0/2163593521 >> v1:172.21.15.72:6789/0 conn(0x7f2258135250 legacy=0x7f22580a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:48.862 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.746+0000 7f225659c700 1 -- 172.21.15.139:0/2163593521 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22581356e0 con 0x7f22580a3f40 2020-02-12T14:12:48.863 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.746+0000 7f2256d9d700 1 --2- 172.21.15.139:0/2163593521 >> v2:172.21.15.72:3300/0 conn(0x7f22580a24a0 0x7f225812e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-12T14:12:48.863 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.746+0000 7f225659c700 1 --2- 172.21.15.139:0/2163593521 >> v2:172.21.15.139:3300/0 conn(0x7f22580a3f40 0x7f2258134df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2258060f00 tx=0x7f224c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.863 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.746+0000 7f225659c700 1 --2- 172.21.15.139:0/2163593521 >> v2:172.21.15.139:3300/0 conn(0x7f22580a3f40 0x7f2258134df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2258060f00 tx=0x7f224c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.863 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.746+0000 7f225659c700 1 --2- 172.21.15.139:0/2163593521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22580a3f40 0x7f2258134df0 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f2258060f00 tx=0x7f224c007a40).ready entity=mon.1 client_cookie=b51164de3da7cabd server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:48.863 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.747+0000 7f225659c700 1 --2- 172.21.15.139:0/2163593521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22580a3f40 0x7f2258134df0 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f2258060f00 tx=0x7f224c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.863 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.747+0000 7f225559a700 1 -- 172.21.15.139:0/2163593521 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f224c0116e0 con 0x7f22580a3f40 2020-02-12T14:12:48.863 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.747+0000 7f225659c700 1 --2- 172.21.15.139:0/2163593521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22580a3f40 0x7f2258134df0 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f2258060f00 tx=0x7f224c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.864 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.747+0000 7f225659c700 1 --2- 172.21.15.139:0/2163593521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22580a3f40 0x7f2258134df0 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f2258060f00 tx=0x7f224c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.864 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.747+0000 7f225559a700 1 -- 172.21.15.139:0/2163593521 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224c011840 con 0x7f22580a3f40 2020-02-12T14:12:48.864 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.747+0000 7f225cacc700 1 -- 172.21.15.139:0/2163593521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22580a3f40 msgr2=0x7f2258134df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:48.864 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.747+0000 7f225559a700 1 -- 172.21.15.139:0/2163593521 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f224c011c20 con 0x7f22580a3f40 2020-02-12T14:12:48.864 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.747+0000 7f225cacc700 1 --2- 172.21.15.139:0/2163593521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22580a3f40 0x7f2258134df0 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f2258060f00 tx=0x7f224c007a40).stop 2020-02-12T14:12:48.864 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.747+0000 7f225cacc700 1 -- 172.21.15.139:0/2163593521 shutdown_connections 2020-02-12T14:12:48.864 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.747+0000 7f225cacc700 1 --2- 172.21.15.139:0/2163593521 >> v2:172.21.15.72:3300/0 conn(0x7f22580a24a0 0x7f225812e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:48.864 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.747+0000 7f225cacc700 1 --2- 172.21.15.139:0/2163593521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22580a3f40 0x7f2258134df0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:48.865 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.747+0000 7f225cacc700 1 -- 172.21.15.139:0/2163593521 >> 172.21.15.139:0/2163593521 conn(0x7f2258060950 msgr2=0x7f225809d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:48.865 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.747+0000 7f225cacc700 1 -- 172.21.15.139:0/2163593521 shutdown_connections 2020-02-12T14:12:48.865 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.747+0000 7f225cacc700 1 -- 172.21.15.139:0/2163593521 wait complete. 2020-02-12T14:12:48.865 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.748+0000 7f225cacc700 1 Processor -- start 2020-02-12T14:12:48.865 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.748+0000 7f225cacc700 1 -- start start 2020-02-12T14:12:48.865 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f225cacc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f22580a24a0 0x7f225812f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:48.866 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f225cacc700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f22580a3f40 0x7f2258131200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:48.866 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f225cacc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2258135250 0x7f225812e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:48.866 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f225cacc700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f225812fcc0 con 0x7f22580a24a0 2020-02-12T14:12:48.866 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f225cacc700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2258130b60 con 0x7f22580a3f40 2020-02-12T14:12:48.866 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f225cacc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225813f630 con 0x7f2258135250 2020-02-12T14:12:48.866 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f2255d9b700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f22580a3f40 0x7f2258131200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:48.866 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f2255d9b700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f22580a3f40 0x7f2258131200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47086/0 (socket says 172.21.15.139:47086) 2020-02-12T14:12:48.866 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f2255d9b700 1 -- 172.21.15.139:0/574399108 learned_addr learned my addr 172.21.15.139:0/574399108 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:48.867 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f225659c700 1 --2- 172.21.15.139:0/574399108 >> v2:172.21.15.72:3300/0 conn(0x7f22580a24a0 0x7f225812f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:48.867 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f2256d9d700 1 --2- 172.21.15.139:0/574399108 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2258135250 0x7f225812e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:48.867 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f2255d9b700 1 -- 172.21.15.139:0/574399108 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2258135250 msgr2=0x7f225812e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:48.867 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f2255d9b700 1 --2- 172.21.15.139:0/574399108 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2258135250 0x7f225812e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:48.867 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f2255d9b700 1 -- 172.21.15.139:0/574399108 >> v2:172.21.15.72:3300/0 conn(0x7f22580a24a0 msgr2=0x7f225812f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:48.867 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f2255d9b700 1 --2- 172.21.15.139:0/574399108 >> v2:172.21.15.72:3300/0 conn(0x7f22580a24a0 0x7f225812f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:48.867 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f2255d9b700 1 -- 172.21.15.139:0/574399108 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2258131b70 con 0x7f22580a3f40 2020-02-12T14:12:48.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f2255d9b700 1 --2- 172.21.15.139:0/574399108 >> v2:172.21.15.139:3300/0 conn(0x7f22580a3f40 0x7f2258131200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2248001f50 tx=0x7f2248002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f2255d9b700 1 --2- 172.21.15.139:0/574399108 >> v2:172.21.15.139:3300/0 conn(0x7f22580a3f40 0x7f2258131200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2248001f50 tx=0x7f2248002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f2255d9b700 1 --2- 172.21.15.139:0/574399108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22580a3f40 0x7f2258131200 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7f2248001f50 tx=0x7f2248002e60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:48.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f2255d9b700 1 --2- 172.21.15.139:0/574399108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22580a3f40 0x7f2258131200 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f2248001f50 tx=0x7f2248002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f2255d9b700 1 --2- 172.21.15.139:0/574399108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22580a3f40 0x7f2258131200 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f2248001f50 tx=0x7f2248002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f22477fe700 1 -- 172.21.15.139:0/574399108 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f224800cc00 con 0x7f22580a3f40 2020-02-12T14:12:48.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f2255d9b700 1 --2- 172.21.15.139:0/574399108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22580a3f40 0x7f2258131200 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f2248001f50 tx=0x7f2248002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f22477fe700 1 -- 172.21.15.139:0/574399108 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224800cd60 con 0x7f22580a3f40 2020-02-12T14:12:48.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f22477fe700 1 -- 172.21.15.139:0/574399108 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f224800e350 con 0x7f22580a3f40 2020-02-12T14:12:48.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f225cacc700 1 -- 172.21.15.139:0/574399108 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2258131e10 con 0x7f22580a3f40 2020-02-12T14:12:48.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.749+0000 7f225cacc700 1 -- 172.21.15.139:0/574399108 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2258131660 con 0x7f22580a3f40 2020-02-12T14:12:48.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.750+0000 7f2255d9b700 1 --2- 172.21.15.139:0/574399108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22580a3f40 0x7f2258131200 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f2248001f50 tx=0x7f2248002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.750+0000 7f22477fe700 1 -- 172.21.15.139:0/574399108 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f224800e5c0 con 0x7f22580a3f40 2020-02-12T14:12:48.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.750+0000 7f2255d9b700 1 --2- 172.21.15.139:0/574399108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22580a3f40 0x7f2258131200 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f2248001f50 tx=0x7f2248002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.750+0000 7f22477fe700 1 --2- 172.21.15.139:0/574399108 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f2234039d00 0x7f223403c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:48.870 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.750+0000 7f225cacc700 1 -- 172.21.15.139:0/574399108 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22581319d0 con 0x7f22580a3f40 2020-02-12T14:12:48.870 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.751+0000 7f22477fe700 1 -- 172.21.15.139:0/574399108 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f2248049800 con 0x7f22580a3f40 2020-02-12T14:12:48.870 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.751+0000 7f225659c700 1 --2- 172.21.15.139:0/574399108 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f2234039d00 0x7f223403c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:48.870 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.751+0000 7f225659c700 1 --2- 172.21.15.139:0/574399108 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f2234039d00 0x7f223403c1c0 crc :-1 s=READY pgs=78 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:48.870 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.754+0000 7f2255d9b700 1 --2- 172.21.15.139:0/574399108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22580a3f40 0x7f2258131200 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f2248001f50 tx=0x7f2248002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.870 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.754+0000 7f22477fe700 1 -- 172.21.15.139:0/574399108 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f22581319d0 con 0x7f22580a3f40 2020-02-12T14:12:48.938 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.935+0000 7f225cacc700 1 -- 172.21.15.139:0/574399108 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f22581319d0 con 0x7f22580a3f40 2020-02-12T14:12:48.938 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.936+0000 7f2255d9b700 1 --2- 172.21.15.139:0/574399108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22580a3f40 0x7f2258131200 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f2248001f50 tx=0x7f2248002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:48.938 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.936+0000 7f22477fe700 1 -- 172.21.15.139:0/574399108 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f22581319d0 con 0x7f22580a3f40 2020-02-12T14:12:48.939 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:12:48.940 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.937+0000 7f225cacc700 1 -- 172.21.15.139:0/574399108 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f2234039d00 msgr2=0x7f223403c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:48.940 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.937+0000 7f225cacc700 1 --2- 172.21.15.139:0/574399108 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f2234039d00 0x7f223403c1c0 crc :-1 s=READY pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:48.940 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.937+0000 7f225cacc700 1 -- 172.21.15.139:0/574399108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22580a3f40 msgr2=0x7f2258131200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:48.940 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.937+0000 7f225cacc700 1 --2- 172.21.15.139:0/574399108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22580a3f40 0x7f2258131200 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7f2248001f50 tx=0x7f2248002e60).stop 2020-02-12T14:12:48.941 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.937+0000 7f225cacc700 1 -- 172.21.15.139:0/574399108 shutdown_connections 2020-02-12T14:12:48.941 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.937+0000 7f225cacc700 1 --2- 172.21.15.139:0/574399108 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2258135250 0x7f225812e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:48.941 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.937+0000 7f225cacc700 1 --2- 172.21.15.139:0/574399108 >> v2:172.21.15.72:3300/0 conn(0x7f22580a24a0 0x7f225812f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:48.941 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.937+0000 7f225cacc700 1 --2- 172.21.15.139:0/574399108 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f2234039d00 0x7f223403c1c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:48.941 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.937+0000 7f225cacc700 1 --2- 172.21.15.139:0/574399108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22580a3f40 0x7f2258131200 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:48.941 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.937+0000 7f225cacc700 1 -- 172.21.15.139:0/574399108 >> 172.21.15.139:0/574399108 conn(0x7f2258060950 msgr2=0x7f22580a4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:48.942 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.937+0000 7f225cacc700 1 -- 172.21.15.139:0/574399108 shutdown_connections 2020-02-12T14:12:48.942 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:48.937+0000 7f225cacc700 1 -- 172.21.15.139:0/574399108 wait complete. 2020-02-12T14:12:48.950 INFO:teuthology.orchestra.run.smithi139.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-02-12T14:12:48.950 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-02-12T14:12:48.951 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-12T14:12:49.062 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.053+0000 7f969c598700 1 Processor -- start 2020-02-12T14:12:49.063 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.053+0000 7f969c598700 1 -- start start 2020-02-12T14:12:49.063 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.054+0000 7f969c598700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f96940abda0 0x7f96940aa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:49.063 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.054+0000 7f969c598700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f969413b810 0x7f969413bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:49.063 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.054+0000 7f969c598700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f96940658c0 0x7f9694065d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:49.063 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.054+0000 7f969c598700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969405c320 con 0x7f96940abda0 2020-02-12T14:12:49.063 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.054+0000 7f969c598700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96940aa7a0 con 0x7f96940658c0 2020-02-12T14:12:49.063 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.054+0000 7f969c598700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96940aaa40 con 0x7f969413b810 2020-02-12T14:12:49.064 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.054+0000 7f969ab35700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f96940658c0 0x7f9694065d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:49.064 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.054+0000 7f969ab35700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f96940658c0 0x7f9694065d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47090/0 (socket says 172.21.15.139:47090) 2020-02-12T14:12:49.064 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.054+0000 7f969ab35700 1 -- 172.21.15.139:0/2866117029 learned_addr learned my addr 172.21.15.139:0/2866117029 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:49.064 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.054+0000 7f9699b33700 1 --2- 172.21.15.139:0/2866117029 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f969413b810 0x7f969413bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:49.064 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.054+0000 7f969a334700 1 --2- 172.21.15.139:0/2866117029 >> v2:172.21.15.72:3300/0 conn(0x7f96940abda0 0x7f96940aa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:49.064 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.054+0000 7f969ab35700 1 -- 172.21.15.139:0/2866117029 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f969413b810 msgr2=0x7f969413bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:49.064 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.054+0000 7f969ab35700 1 --2- 172.21.15.139:0/2866117029 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f969413b810 0x7f969413bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:49.065 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.054+0000 7f969ab35700 1 -- 172.21.15.139:0/2866117029 >> v2:172.21.15.72:3300/0 conn(0x7f96940abda0 msgr2=0x7f96940aa1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:49.065 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.054+0000 7f969ab35700 1 --2- 172.21.15.139:0/2866117029 >> v2:172.21.15.72:3300/0 conn(0x7f96940abda0 0x7f96940aa1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:49.065 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.054+0000 7f969ab35700 1 -- 172.21.15.139:0/2866117029 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96940aace0 con 0x7f96940658c0 2020-02-12T14:12:49.065 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.055+0000 7f969ab35700 1 --2- 172.21.15.139:0/2866117029 >> v2:172.21.15.139:3300/0 conn(0x7f96940658c0 0x7f9694065d30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f968c0032b0 tx=0x7f968c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.065 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.055+0000 7f969ab35700 1 --2- 172.21.15.139:0/2866117029 >> v2:172.21.15.139:3300/0 conn(0x7f96940658c0 0x7f9694065d30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f968c0032b0 tx=0x7f968c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.065 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.055+0000 7f969ab35700 1 --2- 172.21.15.139:0/2866117029 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96940658c0 0x7f9694065d30 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7f968c0032b0 tx=0x7f968c007dc0).ready entity=mon.1 client_cookie=68ef4a62483d5a35 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:49.065 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.055+0000 7f969ab35700 1 --2- 172.21.15.139:0/2866117029 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96940658c0 0x7f9694065d30 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f968c0032b0 tx=0x7f968c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.066 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.055+0000 7f9699332700 1 -- 172.21.15.139:0/2866117029 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f968c00a160 con 0x7f96940658c0 2020-02-12T14:12:49.066 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.055+0000 7f969ab35700 1 --2- 172.21.15.139:0/2866117029 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96940658c0 0x7f9694065d30 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f968c0032b0 tx=0x7f968c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.066 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.055+0000 7f969ab35700 1 --2- 172.21.15.139:0/2866117029 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96940658c0 0x7f9694065d30 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f968c0032b0 tx=0x7f968c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.066 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.055+0000 7f9699332700 1 -- 172.21.15.139:0/2866117029 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968c00a2c0 con 0x7f96940658c0 2020-02-12T14:12:49.066 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.055+0000 7f9699332700 1 -- 172.21.15.139:0/2866117029 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f968c00a6a0 con 0x7f96940658c0 2020-02-12T14:12:49.066 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.055+0000 7f969c598700 1 -- 172.21.15.139:0/2866117029 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96940658c0 msgr2=0x7f9694065d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:49.066 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.055+0000 7f969c598700 1 --2- 172.21.15.139:0/2866117029 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96940658c0 0x7f9694065d30 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7f968c0032b0 tx=0x7f968c007dc0).stop 2020-02-12T14:12:49.067 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.055+0000 7f969c598700 1 -- 172.21.15.139:0/2866117029 shutdown_connections 2020-02-12T14:12:49.067 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.055+0000 7f969c598700 1 --2- 172.21.15.139:0/2866117029 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96940658c0 0x7f9694065d30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:49.067 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.055+0000 7f969c598700 1 --2- 172.21.15.139:0/2866117029 >> v2:172.21.15.72:3300/0 conn(0x7f96940abda0 0x7f96940aa1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:49.067 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.055+0000 7f969c598700 1 --2- 172.21.15.139:0/2866117029 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f969413b810 0x7f969413bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:49.067 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.055+0000 7f969c598700 1 -- 172.21.15.139:0/2866117029 >> 172.21.15.139:0/2866117029 conn(0x7f9694060b90 msgr2=0x7f96940ab310 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:49.067 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.055+0000 7f969c598700 1 -- 172.21.15.139:0/2866117029 shutdown_connections 2020-02-12T14:12:49.067 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.055+0000 7f969c598700 1 -- 172.21.15.139:0/2866117029 wait complete. 2020-02-12T14:12:49.067 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.056+0000 7f969c598700 1 Processor -- start 2020-02-12T14:12:49.068 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.056+0000 7f969c598700 1 -- start start 2020-02-12T14:12:49.068 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.057+0000 7f969c598700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f969413b810 0x7f9694151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:49.068 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.057+0000 7f969c598700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9694138b80 con 0x7f96940658c0 2020-02-12T14:12:49.068 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.057+0000 7f969c598700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f969409e0f0 con 0x7f96940abda0 2020-02-12T14:12:49.068 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.057+0000 7f969c598700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969409e390 con 0x7f969413b810 2020-02-12T14:12:49.068 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.057+0000 7f9699b33700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f96940abda0 0x7f9694132ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35736/0 (socket says 172.21.15.139:35736) 2020-02-12T14:12:49.068 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.057+0000 7f9699b33700 1 -- 172.21.15.139:0/1267365758 learned_addr learned my addr 172.21.15.139:0/1267365758 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:49.069 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.057+0000 7f96837fe700 1 -- 172.21.15.139:0/1267365758 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129522413 0 0) 0x7f969409e0f0 con 0x7f96940abda0 2020-02-12T14:12:49.069 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.057+0000 7f96837fe700 1 -- 172.21.15.139:0/1267365758 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9674002fe0 con 0x7f96940abda0 2020-02-12T14:12:49.069 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.057+0000 7f969ab35700 1 --2- 172.21.15.139:0/1267365758 >> v2:172.21.15.72:3300/0 conn(0x7f969413b810 0x7f9694151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:49.069 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.057+0000 7f96837fe700 1 -- 172.21.15.139:0/1267365758 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 524628389 0 0) 0x7f9674002fe0 con 0x7f96940abda0 2020-02-12T14:12:49.069 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.057+0000 7f96837fe700 1 -- 172.21.15.139:0/1267365758 --> v1:172.21.15.139:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f969409e0f0 con 0x7f96940abda0 2020-02-12T14:12:49.069 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.057+0000 7f96837fe700 1 -- 172.21.15.139:0/1267365758 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7f96900027a0 con 0x7f96940abda0 2020-02-12T14:12:49.069 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.057+0000 7f96837fe700 1 -- 172.21.15.139:0/1267365758 >> v2:172.21.15.72:3300/0 conn(0x7f969413b810 msgr2=0x7f9694151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:49.070 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.057+0000 7f96837fe700 1 --2- 172.21.15.139:0/1267365758 >> v2:172.21.15.72:3300/0 conn(0x7f969413b810 0x7f9694151130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:49.070 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.057+0000 7f96837fe700 1 -- 172.21.15.139:0/1267365758 >> v1:172.21.15.139:6789/0 conn(0x7f96940abda0 legacy=0x7f9694132ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:49.070 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.057+0000 7f96837fe700 1 -- 172.21.15.139:0/1267365758 >> v1:172.21.15.72:6789/0 conn(0x7f96940658c0 legacy=0x7f96940a1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:49.070 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.057+0000 7f96837fe700 1 --2- 172.21.15.139:0/1267365758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96740049b0 0x7f9674004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:49.070 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.057+0000 7f96837fe700 1 --2- 172.21.15.139:0/1267365758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9674003920 0x7f9674003da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:49.070 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.057+0000 7f96837fe700 1 --2- 172.21.15.139:0/1267365758 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9674004200 0x7f967400b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:49.070 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.057+0000 7f96837fe700 1 -- 172.21.15.139:0/1267365758 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969409e390 con 0x7f9674003920 2020-02-12T14:12:49.070 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.057+0000 7f96837fe700 1 -- 172.21.15.139:0/1267365758 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9674004770 con 0x7f96740049b0 2020-02-12T14:12:49.071 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.057+0000 7f96837fe700 1 -- 172.21.15.139:0/1267365758 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f967400bbb0 con 0x7f9674004200 2020-02-12T14:12:49.071 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.057+0000 7f969a334700 1 --2- 172.21.15.139:0/1267365758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96740049b0 0x7f9674004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:49.071 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.057+0000 7f9699b33700 1 --2- 172.21.15.139:0/1267365758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9674003920 0x7f9674003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:49.071 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.058+0000 7f969ab35700 1 --2- 172.21.15.139:0/1267365758 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9674004200 0x7f967400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:49.071 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.058+0000 7f969a334700 1 -- 172.21.15.139:0/1267365758 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9674004200 msgr2=0x7f967400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:49.071 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.058+0000 7f969a334700 1 --2- 172.21.15.139:0/1267365758 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9674004200 0x7f967400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:49.071 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.058+0000 7f969a334700 1 -- 172.21.15.139:0/1267365758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9674003920 msgr2=0x7f9674003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:49.072 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.058+0000 7f969a334700 1 --2- 172.21.15.139:0/1267365758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9674003920 0x7f9674003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:49.072 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.058+0000 7f969a334700 1 -- 172.21.15.139:0/1267365758 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969409e630 con 0x7f96740049b0 2020-02-12T14:12:49.072 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.058+0000 7f969c598700 1 -- 172.21.15.139:0/1267365758 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9694134710 con 0x7f96740049b0 2020-02-12T14:12:49.072 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.058+0000 7f969ab35700 1 --2- 172.21.15.139:0/1267365758 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9674004200 0x7f967400b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T14:12:49.072 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.058+0000 7f969ab35700 1 -- 172.21.15.139:0/1267365758 reap_dead start 2020-02-12T14:12:49.073 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.058+0000 7f969a334700 1 --2- 172.21.15.139:0/1267365758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96740049b0 0x7f9674004d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9694134060 tx=0x7f96840109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.073 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.058+0000 7f969c598700 1 -- 172.21.15.139:0/1267365758 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9694134bc0 con 0x7f96740049b0 2020-02-12T14:12:49.073 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.058+0000 7f969a334700 1 --2- 172.21.15.139:0/1267365758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96740049b0 0x7f9674004d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9694134060 tx=0x7f96840109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.073 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.058+0000 7f969a334700 1 --2- 172.21.15.139:0/1267365758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96740049b0 0x7f9674004d90 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7f9694134060 tx=0x7f96840109c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:49.073 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.058+0000 7f969a334700 1 --2- 172.21.15.139:0/1267365758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96740049b0 0x7f9674004d90 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f9694134060 tx=0x7f96840109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.073 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.058+0000 7f96837fe700 1 -- 172.21.15.139:0/1267365758 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9684007540 con 0x7f96740049b0 2020-02-12T14:12:49.074 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.058+0000 7f969a334700 1 --2- 172.21.15.139:0/1267365758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96740049b0 0x7f9674004d90 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f9694134060 tx=0x7f96840109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.074 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.058+0000 7f96837fe700 1 -- 172.21.15.139:0/1267365758 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96840059c0 con 0x7f96740049b0 2020-02-12T14:12:49.074 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.058+0000 7f969a334700 1 --2- 172.21.15.139:0/1267365758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96740049b0 0x7f9674004d90 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f9694134060 tx=0x7f96840109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.074 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.058+0000 7f96837fe700 1 -- 172.21.15.139:0/1267365758 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9684005da0 con 0x7f96740049b0 2020-02-12T14:12:49.074 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.058+0000 7f969a334700 1 --2- 172.21.15.139:0/1267365758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96740049b0 0x7f9674004d90 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f9694134060 tx=0x7f96840109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.074 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.059+0000 7f96837fe700 1 -- 172.21.15.139:0/1267365758 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f968400a180 con 0x7f96740049b0 2020-02-12T14:12:49.074 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.059+0000 7f969a334700 1 --2- 172.21.15.139:0/1267365758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96740049b0 0x7f9674004d90 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f9694134060 tx=0x7f96840109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.075 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.059+0000 7f969c598700 1 -- 172.21.15.139:0/1267365758 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96940ab110 con 0x7f96740049b0 2020-02-12T14:12:49.075 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.059+0000 7f96837fe700 1 --2- 172.21.15.139:0/1267365758 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f967403dd40 0x7f9674040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:49.075 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.059+0000 7f96837fe700 1 -- 172.21.15.139:0/1267365758 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f96840493e0 con 0x7f96740049b0 2020-02-12T14:12:49.075 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.059+0000 7f9699b33700 1 --2- 172.21.15.139:0/1267365758 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f967403dd40 0x7f9674040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:49.075 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.059+0000 7f9699b33700 1 --2- 172.21.15.139:0/1267365758 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f967403dd40 0x7f9674040200 crc :-1 s=READY pgs=79 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:49.076 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.063+0000 7f969a334700 1 --2- 172.21.15.139:0/1267365758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96740049b0 0x7f9674004d90 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f9694134060 tx=0x7f96840109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.076 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.063+0000 7f96837fe700 1 -- 172.21.15.139:0/1267365758 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f968402ea70 con 0x7f96740049b0 2020-02-12T14:12:49.202 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.200+0000 7f969c598700 1 -- 172.21.15.139:0/1267365758 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9694067e20 con 0x7f96740049b0 2020-02-12T14:12:49.203 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.200+0000 7f969a334700 1 --2- 172.21.15.139:0/1267365758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96740049b0 0x7f9674004d90 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f9694134060 tx=0x7f96840109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.203 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.200+0000 7f96837fe700 1 -- 172.21.15.139:0/1267365758 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14933 (secure 0 0 0) 0x7f9684031560 con 0x7f96740049b0 2020-02-12T14:12:49.203 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:12:49.203 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":23,"fsid":"dacc9a6c-9e88-46ac-940b-c4a329dbffec","created":"2020-02-12T14:12:18.258232+0000","modified":"2020-02-12T14:12:39.447885+0000","last_up_change":"2020-02-12T14:12:27.050924+0000","last_in_change":"2020-02-12T14:12:27.050924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-12T14:12:31.091380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-02-12T14:12:34.160095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-02-12T14:12:37.119732+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffc0664d-9b93-45a4-a454-7655ee26d582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":22147},{"type":"v1","addr":"172.21.15.139:6803","nonce":22147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":22147},{"type":"v1","addr":"172.21.15.139:6805","nonce":22147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":22147},{"type":"v1","addr":"172.21.15.139:6809","nonce":22147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":22147},{"type":"v1","addr":"172.21.15.139:6807","nonce":22147}]},"public_addr":"172.21.15.139:6803/22147","cluster_addr":"172.21.15.139:6805/22147","heartbeat_back_addr":"172.21.15.139:6809/22147","heartbeat_front_addr":"172.21.15.139:6807/22147","state":["exists","up"]},{"osd":1,"uuid":"f66da6bc-43b3-4846-85f9-a25e3fe95216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":22148},{"type":"v1","addr":"172.21.15.139:6811","nonce":22148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":22148},{"type":"v1","addr":"172.21.15.139:6813","nonce":22148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6819","nonce":22148},{"type":"v1","addr":"172.21.15.139:6821","nonce":22148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6815","nonce":22148},{"type":"v1","addr":"172.21.15.139:6817","nonce":22148}]},"public_addr":"172.21.15.139:6811/22148","cluster_addr":"172.21.15.139:6813/22148","heartbeat_back_addr":"172.21.15.139:6821/22148","heartbeat_front_addr":"172.21.15.139:6817/22148","state":["exists","up"]},{"osd":2,"uuid":"c35fb293-3e16-41e8-85f3-768e11e55b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":22149},{"type":"v1","addr":"172.21.15.139:6827","nonce":22149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":22149},{"type":"v1","addr":"172.21.15.139:6829","nonce":22149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":22149},{"type":"v1","addr":"172.21.15.139:6833","nonce":22149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":22149},{"type":"v1","addr":"172.21.15.139:6831","nonce":22149}]},"public_addr":"172.21.15.139:6827/22149","cluster_addr":"172.21.15.139:6829/22149","heartbeat_back_addr":"172.21.15.139:6833/22149","heartbeat_front_addr":"172.21.15.139:6831/22149","state":["exists","up"]},{"osd":3,"uuid":"bc8b2c0d-e3dd-48cb-883e-6ea965aee923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":22150},{"type":"v1","addr":"172.21.15.139:6816","nonce":22150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":22150},{"type":"v1","addr":"172.21.15.139:6820","nonce":22150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":22150},{"type":"v1","addr":"172.21.15.139:6825","nonce":22150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":22150},{"type":"v1","addr":"172.21.15.139:6823","nonce":22150}]},"public_addr":"172.21.15.139:6816/22150","cluster_addr":"172.21.15.139:6820/22150","heartbeat_back_addr":"172.21.15.139:6825/22150","heartbeat_front_addr":"172.21.15.139:6823/22150","state":["exists","up"]},{"osd":4,"uuid":"aadfc406-0c40-4b6b-9e19-c92b2f40264a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":21598},{"type":"v1","addr":"172.21.15.72:6801","nonce":21598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":21598},{"type":"v1","addr":"172.21.15.72:6803","nonce":21598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":21598},{"type":"v1","addr":"172.21.15.72:6807","nonce":21598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":21598},{"type":"v1","addr":"172.21.15.72:6805","nonce":21598}]},"public_addr":"172.21.15.72:6801/21598","cluster_addr":"172.21.15.72:6803/21598","heartbeat_back_addr":"172.21.15.72:6807/21598","heartbeat_front_addr":"172.21.15.72:6805/21598","state":["exists","up"]},{"osd":5,"uuid":"3296dc8e-9322-4430-abd2-7672da5b7acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":21599},{"type":"v1","addr":"172.21.15.72:6810","nonce":21599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":21599},{"type":"v1","addr":"172.21.15.72:6815","nonce":21599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":21599},{"type":"v1","addr":"172.21.15.72:6823","nonce":21599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":21599},{"type":"v1","addr":"172.21.15.72:6820","nonce":21599}]},"public_addr":"172.21.15.72:6810/21599","cluster_addr":"172.21.15.72:6815/21599","heartbeat_back_addr":"172.21.15.72:6823/21599","heartbeat_front_addr":"172.21.15.72:6820/21599","state":["exists","up"]},{"osd":6,"uuid":"7c39cf20-a3a8-4d56-8577-f4102b302a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":21601},{"type":"v1","addr":"172.21.15.72:6811","nonce":21601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":21601},{"type":"v1","addr":"172.21.15.72:6814","nonce":21601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":21601},{"type":"v1","addr":"172.21.15.72:6821","nonce":21601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":21601},{"type":"v1","addr":"172.21.15.72:6818","nonce":21601}]},"public_addr":"172.21.15.72:6811/21601","cluster_addr":"172.21.15.72:6814/21601","heartbeat_back_addr":"172.21.15.72:6821/21601","heartbeat_front_addr":"172.21.15.72:6818/21601","state":["exists","up"]},{"osd":7,"uuid":"f452adff-8432-47e9-a5f1-9fd7e2a04a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":21600},{"type":"v1","addr":"172.21.15.72:6825","nonce":21600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":21600},{"type":"v1","addr":"172.21.15.72:6827","nonce":21600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":21600},{"type":"v1","addr":"172.21.15.72:6831","nonce":21600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":21600},{"type":"v1","addr":"172.21.15.72:6829","nonce":21600}]},"public_addr":"172.21.15.72:6825/21600","cluster_addr":"172.21.15.72:6827/21600","heartbeat_back_addr":"172.21.15.72:6831/21600","heartbeat_front_addr":"172.21.15.72:6829/21600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.259782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.267019+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.315501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.326256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.335328+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.284130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.083179+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.351445+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-12T14:12:49.205 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.202+0000 7f969c598700 1 -- 172.21.15.139:0/1267365758 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f967403dd40 msgr2=0x7f9674040200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:49.205 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.202+0000 7f969c598700 1 --2- 172.21.15.139:0/1267365758 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f967403dd40 0x7f9674040200 crc :-1 s=READY pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:49.205 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.202+0000 7f969c598700 1 -- 172.21.15.139:0/1267365758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96740049b0 msgr2=0x7f9674004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:49.205 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.202+0000 7f969c598700 1 --2- 172.21.15.139:0/1267365758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96740049b0 0x7f9674004d90 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7f9694134060 tx=0x7f96840109c0).stop 2020-02-12T14:12:49.205 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.202+0000 7f969c598700 1 -- 172.21.15.139:0/1267365758 shutdown_connections 2020-02-12T14:12:49.205 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.202+0000 7f969c598700 1 --2- 172.21.15.139:0/1267365758 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f967403dd40 0x7f9674040200 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:49.206 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.202+0000 7f969c598700 1 --2- 172.21.15.139:0/1267365758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96740049b0 0x7f9674004d90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:49.206 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.202+0000 7f969c598700 1 -- 172.21.15.139:0/1267365758 >> 172.21.15.139:0/1267365758 conn(0x7f9694060b90 msgr2=0x7f969405e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:49.206 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.202+0000 7f969c598700 1 -- 172.21.15.139:0/1267365758 shutdown_connections 2020-02-12T14:12:49.206 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.202+0000 7f969c598700 1 -- 172.21.15.139:0/1267365758 wait complete. 2020-02-12T14:12:49.215 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-12T14:12:31.091380+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-12T14:12:34.160095+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-12T14:12:37.119732+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-02-12T14:12:49.215 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-02-12T14:12:49.324 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.322+0000 7fcccc284700 1 Processor -- start 2020-02-12T14:12:49.324 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.322+0000 7fcccc284700 1 -- start start 2020-02-12T14:12:49.327 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.322+0000 7fcccc284700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fccc4135500 0x7fccc40a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:49.327 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.322+0000 7fcccc284700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fccc40a21f0 0x7fccc412e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:49.327 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.322+0000 7fcccc284700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc41359e0 con 0x7fccc40a3f40 2020-02-12T14:12:49.327 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.322+0000 7fcccc284700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc4135c80 con 0x7fccc40a21f0 2020-02-12T14:12:49.327 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.322+0000 7fcccc284700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40a18f0 con 0x7fccc4135500 2020-02-12T14:12:49.327 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.323+0000 7fccc981f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fccc4135500 0x7fccc40a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:49.328 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.323+0000 7fccca821700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fccc40a21f0 0x7fccc412e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:49.328 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.323+0000 7fccca821700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fccc40a21f0 0x7fccc412e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.139:50022/0 (socket says 172.21.15.139:50022) 2020-02-12T14:12:49.328 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.323+0000 7fccc981f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fccc4135500 0x7fccc40a1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.139:39700/0 (socket says 172.21.15.139:39700) 2020-02-12T14:12:49.328 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.323+0000 7fccca821700 1 -- 172.21.15.139:0/4091290532 learned_addr learned my addr 172.21.15.139:0/4091290532 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:49.328 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.323+0000 7fccca020700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fccc40a3f40 0x7fccc4134df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.139:49622/0 (socket says 172.21.15.139:49622) 2020-02-12T14:12:49.328 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.323+0000 7fccca821700 1 -- 172.21.15.139:0/4091290532 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fccc4135500 msgr2=0x7fccc40a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:49.328 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.323+0000 7fccca821700 1 --2- 172.21.15.139:0/4091290532 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fccc4135500 0x7fccc40a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:49.328 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.323+0000 7fccca821700 1 -- 172.21.15.139:0/4091290532 >> v1:172.21.15.72:6789/0 conn(0x7fccc40a3f40 legacy=0x7fccc4134df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:49.329 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.323+0000 7fccca821700 1 -- 172.21.15.139:0/4091290532 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc40a2680 con 0x7fccc40a21f0 2020-02-12T14:12:49.329 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.323+0000 7fccc901e700 1 -- 172.21.15.139:0/4091290532 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2108277089 0 0) 0x7fccc41359e0 con 0x7fccc40a3f40 2020-02-12T14:12:49.329 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.323+0000 7fccca821700 1 --2- 172.21.15.139:0/4091290532 >> v2:172.21.15.72:3300/0 conn(0x7fccc40a21f0 0x7fccc412e6b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fccbc0032b0 tx=0x7fccbc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.329 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.323+0000 7fccca821700 1 --2- 172.21.15.139:0/4091290532 >> v2:172.21.15.72:3300/0 conn(0x7fccc40a21f0 0x7fccc412e6b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fccbc0032b0 tx=0x7fccbc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.329 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.323+0000 7fccca821700 1 --2- 172.21.15.139:0/4091290532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccc40a21f0 0x7fccc412e6b0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7fccbc0032b0 tx=0x7fccbc008c60).ready entity=mon.0 client_cookie=4ba0e4a8318564bc server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:49.329 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.323+0000 7fccca821700 1 --2- 172.21.15.139:0/4091290532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccc40a21f0 0x7fccc412e6b0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7fccbc0032b0 tx=0x7fccbc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.330 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.323+0000 7fccc901e700 1 -- 172.21.15.139:0/4091290532 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccbc00a160 con 0x7fccc40a21f0 2020-02-12T14:12:49.330 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.323+0000 7fccca821700 1 --2- 172.21.15.139:0/4091290532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccc40a21f0 0x7fccc412e6b0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7fccbc0032b0 tx=0x7fccbc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.330 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.323+0000 7fccc901e700 1 -- 172.21.15.139:0/4091290532 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccbc00a2c0 con 0x7fccc40a21f0 2020-02-12T14:12:49.330 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.323+0000 7fccca821700 1 --2- 172.21.15.139:0/4091290532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccc40a21f0 0x7fccc412e6b0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7fccbc0032b0 tx=0x7fccbc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.330 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.323+0000 7fccc901e700 1 -- 172.21.15.139:0/4091290532 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccbc00a660 con 0x7fccc40a21f0 2020-02-12T14:12:49.330 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.323+0000 7fcccc284700 1 -- 172.21.15.139:0/4091290532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccc40a21f0 msgr2=0x7fccc412e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:49.330 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.323+0000 7fcccc284700 1 --2- 172.21.15.139:0/4091290532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccc40a21f0 0x7fccc412e6b0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7fccbc0032b0 tx=0x7fccbc008c60).stop 2020-02-12T14:12:49.331 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.324+0000 7fcccc284700 1 -- 172.21.15.139:0/4091290532 shutdown_connections 2020-02-12T14:12:49.331 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.324+0000 7fcccc284700 1 --2- 172.21.15.139:0/4091290532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccc40a21f0 0x7fccc412e6b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:49.331 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.324+0000 7fcccc284700 1 --2- 172.21.15.139:0/4091290532 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fccc4135500 0x7fccc40a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:49.331 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.324+0000 7fcccc284700 1 -- 172.21.15.139:0/4091290532 >> 172.21.15.139:0/4091290532 conn(0x7fccc4060950 msgr2=0x7fccc409d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:49.331 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.324+0000 7fcccc284700 1 -- 172.21.15.139:0/4091290532 shutdown_connections 2020-02-12T14:12:49.331 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.324+0000 7fcccc284700 1 -- 172.21.15.139:0/4091290532 wait complete. 2020-02-12T14:12:49.331 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.325+0000 7fcccc284700 1 Processor -- start 2020-02-12T14:12:49.331 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.325+0000 7fcccc284700 1 -- start start 2020-02-12T14:12:49.335 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.325+0000 7fcccc284700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fccc40a21f0 0x7fccc4138250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:49.335 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.325+0000 7fcccc284700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc41365c0 con 0x7fccc4135500 2020-02-12T14:12:49.335 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.325+0000 7fcccc284700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc4136860 con 0x7fccc40a3f40 2020-02-12T14:12:49.336 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.325+0000 7fcccc284700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc409ff00 con 0x7fccc40a21f0 2020-02-12T14:12:49.336 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.325+0000 7fccc981f700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fccc40a3f40 0x7fccc41287e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35756/0 (socket says 172.21.15.139:35756) 2020-02-12T14:12:49.336 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.325+0000 7fccc981f700 1 -- 172.21.15.139:0/721794270 learned_addr learned my addr 172.21.15.139:0/721794270 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:49.336 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.326+0000 7fccca020700 1 --2- 172.21.15.139:0/721794270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fccc40a21f0 0x7fccc4138250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:49.336 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.326+0000 7fccb37fe700 1 -- 172.21.15.139:0/721794270 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 492264485 0 0) 0x7fccc4136860 con 0x7fccc40a3f40 2020-02-12T14:12:49.336 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.326+0000 7fccb37fe700 1 -- 172.21.15.139:0/721794270 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcca4002fe0 con 0x7fccc40a3f40 2020-02-12T14:12:49.336 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.326+0000 7fccb37fe700 1 -- 172.21.15.139:0/721794270 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200042365 0 0) 0x7fccc41365c0 con 0x7fccc4135500 2020-02-12T14:12:49.337 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.326+0000 7fccb37fe700 1 -- 172.21.15.139:0/721794270 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccc4136860 con 0x7fccc4135500 2020-02-12T14:12:49.337 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.326+0000 7fccb37fe700 1 -- 172.21.15.139:0/721794270 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4050033972 0 0) 0x7fcca4002fe0 con 0x7fccc40a3f40 2020-02-12T14:12:49.337 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.326+0000 7fccca020700 1 -- 172.21.15.139:0/721794270 >> v1:172.21.15.139:6789/0 conn(0x7fccc40a3f40 legacy=0x7fccc41287e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:49.337 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.326+0000 7fccca020700 1 -- 172.21.15.139:0/721794270 >> v1:172.21.15.72:6789/0 conn(0x7fccc4135500 legacy=0x7fccc414b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:49.337 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.326+0000 7fccca020700 1 -- 172.21.15.139:0/721794270 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc41362b0 con 0x7fccc40a21f0 2020-02-12T14:12:49.337 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.326+0000 7fccca020700 1 --2- 172.21.15.139:0/721794270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fccc40a21f0 0x7fccc4138250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fccb4008800 tx=0x7fccc0010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.337 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.326+0000 7fccca020700 1 --2- 172.21.15.139:0/721794270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fccc40a21f0 0x7fccc4138250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fccb4008800 tx=0x7fccc0010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.338 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.326+0000 7fccca020700 1 --2- 172.21.15.139:0/721794270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fccc40a21f0 0x7fccc4138250 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7fccb4008800 tx=0x7fccc0010850).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:49.338 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.326+0000 7fccca020700 1 --2- 172.21.15.139:0/721794270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fccc40a21f0 0x7fccc4138250 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fccb4008800 tx=0x7fccc0010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.338 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.326+0000 7fccb37fe700 1 -- 172.21.15.139:0/721794270 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccb40086a0 con 0x7fccc40a21f0 2020-02-12T14:12:49.338 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.326+0000 7fccca020700 1 --2- 172.21.15.139:0/721794270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fccc40a21f0 0x7fccc4138250 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fccb4008800 tx=0x7fccc0010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.338 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.326+0000 7fccb37fe700 1 -- 172.21.15.139:0/721794270 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc00112f0 con 0x7fccc40a21f0 2020-02-12T14:12:49.338 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.326+0000 7fccca020700 1 --2- 172.21.15.139:0/721794270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fccc40a21f0 0x7fccc4138250 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fccb4008800 tx=0x7fccc0010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.338 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.326+0000 7fcccc284700 1 -- 172.21.15.139:0/721794270 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc4137d40 con 0x7fccc40a21f0 2020-02-12T14:12:49.338 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.326+0000 7fccb37fe700 1 -- 172.21.15.139:0/721794270 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccc0011690 con 0x7fccc40a21f0 2020-02-12T14:12:49.339 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.326+0000 7fcccc284700 1 -- 172.21.15.139:0/721794270 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc4135ee0 con 0x7fccc40a21f0 2020-02-12T14:12:49.339 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.327+0000 7fccca020700 1 --2- 172.21.15.139:0/721794270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fccc40a21f0 0x7fccc4138250 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fccb4008800 tx=0x7fccc0010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.339 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.327+0000 7fccb37fe700 1 -- 172.21.15.139:0/721794270 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fccc000b0a0 con 0x7fccc40a21f0 2020-02-12T14:12:49.339 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.327+0000 7fccca020700 1 --2- 172.21.15.139:0/721794270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fccc40a21f0 0x7fccc4138250 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fccb4008800 tx=0x7fccc0010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.339 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.328+0000 7fccb37fe700 1 --2- 172.21.15.139:0/721794270 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fcca4039f90 0x7fcca403c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:49.340 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.328+0000 7fccb37fe700 1 -- 172.21.15.139:0/721794270 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fccc0049390 con 0x7fccc40a21f0 2020-02-12T14:12:49.340 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.328+0000 7fcccc284700 1 -- 172.21.15.139:0/721794270 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc41369f0 con 0x7fccc40a21f0 2020-02-12T14:12:49.340 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.328+0000 7fccc981f700 1 --2- 172.21.15.139:0/721794270 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fcca4039f90 0x7fcca403c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:49.340 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.328+0000 7fccc981f700 1 --2- 172.21.15.139:0/721794270 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fcca4039f90 0x7fcca403c450 crc :-1 s=READY pgs=80 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:49.340 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.333+0000 7fccca020700 1 --2- 172.21.15.139:0/721794270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fccc40a21f0 0x7fccc4138250 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fccb4008800 tx=0x7fccc0010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.340 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.333+0000 7fccb37fe700 1 -- 172.21.15.139:0/721794270 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fccc002ea60 con 0x7fccc40a21f0 2020-02-12T14:12:49.471 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.469+0000 7fcccc284700 1 -- 172.21.15.139:0/721794270 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fccc4067e20 con 0x7fccc40a21f0 2020-02-12T14:12:49.472 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.471+0000 7fccca020700 1 --2- 172.21.15.139:0/721794270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fccc40a21f0 0x7fccc4138250 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fccb4008800 tx=0x7fccc0010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.472 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.471+0000 7fccb37fe700 1 -- 172.21.15.139:0/721794270 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fccc00090e0 con 0x7fccc40a21f0 2020-02-12T14:12:49.472 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 8 2020-02-12T14:12:49.474 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.471+0000 7fcccc284700 1 -- 172.21.15.139:0/721794270 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fcca4039f90 msgr2=0x7fcca403c450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:49.474 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.471+0000 7fcccc284700 1 --2- 172.21.15.139:0/721794270 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fcca4039f90 0x7fcca403c450 crc :-1 s=READY pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:49.474 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.471+0000 7fcccc284700 1 -- 172.21.15.139:0/721794270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fccc40a21f0 msgr2=0x7fccc4138250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:49.475 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.471+0000 7fcccc284700 1 --2- 172.21.15.139:0/721794270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fccc40a21f0 0x7fccc4138250 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7fccb4008800 tx=0x7fccc0010850).stop 2020-02-12T14:12:49.475 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.471+0000 7fcccc284700 1 -- 172.21.15.139:0/721794270 shutdown_connections 2020-02-12T14:12:49.475 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.471+0000 7fcccc284700 1 --2- 172.21.15.139:0/721794270 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fcca4039f90 0x7fcca403c450 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:49.475 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.471+0000 7fcccc284700 1 --2- 172.21.15.139:0/721794270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fccc40a21f0 0x7fccc4138250 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:49.475 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.471+0000 7fcccc284700 1 -- 172.21.15.139:0/721794270 >> 172.21.15.139:0/721794270 conn(0x7fccc4060950 msgr2=0x7fccc405b110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:49.475 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.471+0000 7fcccc284700 1 -- 172.21.15.139:0/721794270 shutdown_connections 2020-02-12T14:12:49.476 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.472+0000 7fcccc284700 1 -- 172.21.15.139:0/721794270 wait complete. 2020-02-12T14:12:49.484 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-02-12T14:12:49.592 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.591+0000 7f5199ab9700 1 Processor -- start 2020-02-12T14:12:49.592 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.591+0000 7f5199ab9700 1 -- start start 2020-02-12T14:12:49.598 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.591+0000 7f5199ab9700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f519405ab20 0x7f519405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:49.598 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.591+0000 7f5199ab9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f519412fac0 0x7f519412ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:49.598 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.591+0000 7f5199ab9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51940a4530 con 0x7f51940a3de0 2020-02-12T14:12:49.598 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.591+0000 7f5199ab9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51940a4fe0 con 0x7f519412fac0 2020-02-12T14:12:49.599 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.591+0000 7f5199ab9700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51940a5280 con 0x7f519405ab20 2020-02-12T14:12:49.599 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.591+0000 7f518bfff700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f519405ab20 0x7f519405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:49.599 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.591+0000 7f518bfff700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f519405ab20 0x7f519405afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47124/0 (socket says 172.21.15.139:47124) 2020-02-12T14:12:49.599 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.591+0000 7f518bfff700 1 -- 172.21.15.139:0/3903891280 learned_addr learned my addr 172.21.15.139:0/3903891280 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:49.599 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.591+0000 7f5193fff700 1 --2- 172.21.15.139:0/3903891280 >> v2:172.21.15.72:3300/0 conn(0x7f519412fac0 0x7f519412ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:49.599 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.591+0000 7f518bfff700 1 -- 172.21.15.139:0/3903891280 >> v2:172.21.15.72:3300/0 conn(0x7f519412fac0 msgr2=0x7f519412ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:49.599 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.591+0000 7f518bfff700 1 --2- 172.21.15.139:0/3903891280 >> v2:172.21.15.72:3300/0 conn(0x7f519412fac0 0x7f519412ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:49.600 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.591+0000 7f518bfff700 1 -- 172.21.15.139:0/3903891280 >> v1:172.21.15.72:6789/0 conn(0x7f51940a3de0 legacy=0x7f519409e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:49.600 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.591+0000 7f518bfff700 1 -- 172.21.15.139:0/3903891280 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519405b430 con 0x7f519405ab20 2020-02-12T14:12:49.600 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.591+0000 7f518bfff700 1 --2- 172.21.15.139:0/3903891280 >> v2:172.21.15.139:3300/0 conn(0x7f519405ab20 0x7f519405afd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f517c002f30 tx=0x7f517c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.600 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.591+0000 7f518bfff700 1 --2- 172.21.15.139:0/3903891280 >> v2:172.21.15.139:3300/0 conn(0x7f519405ab20 0x7f519405afd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f517c002f30 tx=0x7f517c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.600 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.591+0000 7f518bfff700 1 --2- 172.21.15.139:0/3903891280 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f519405ab20 0x7f519405afd0 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7f517c002f30 tx=0x7f517c007a40).ready entity=mon.1 client_cookie=2cae609a25d76ba5 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:49.600 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.591+0000 7f518bfff700 1 --2- 172.21.15.139:0/3903891280 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f519405ab20 0x7f519405afd0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f517c002f30 tx=0x7f517c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.600 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.591+0000 7f5192ffd700 1 -- 172.21.15.139:0/3903891280 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f517c011670 con 0x7f519405ab20 2020-02-12T14:12:49.600 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.591+0000 7f518bfff700 1 --2- 172.21.15.139:0/3903891280 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f519405ab20 0x7f519405afd0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f517c002f30 tx=0x7f517c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.601 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.591+0000 7f518bfff700 1 --2- 172.21.15.139:0/3903891280 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f519405ab20 0x7f519405afd0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f517c002f30 tx=0x7f517c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.601 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.591+0000 7f5192ffd700 1 -- 172.21.15.139:0/3903891280 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c0117d0 con 0x7f519405ab20 2020-02-12T14:12:49.601 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.591+0000 7f5192ffd700 1 -- 172.21.15.139:0/3903891280 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f517c011bb0 con 0x7f519405ab20 2020-02-12T14:12:49.601 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.591+0000 7f5199ab9700 1 -- 172.21.15.139:0/3903891280 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f519405ab20 msgr2=0x7f519405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:49.601 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.591+0000 7f5199ab9700 1 --2- 172.21.15.139:0/3903891280 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f519405ab20 0x7f519405afd0 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7f517c002f30 tx=0x7f517c007a40).stop 2020-02-12T14:12:49.601 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.592+0000 7f5199ab9700 1 -- 172.21.15.139:0/3903891280 shutdown_connections 2020-02-12T14:12:49.601 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.592+0000 7f5199ab9700 1 --2- 172.21.15.139:0/3903891280 >> v2:172.21.15.72:3300/0 conn(0x7f519412fac0 0x7f519412ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:49.602 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.592+0000 7f5199ab9700 1 --2- 172.21.15.139:0/3903891280 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f519405ab20 0x7f519405afd0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:49.602 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.592+0000 7f5199ab9700 1 -- 172.21.15.139:0/3903891280 >> 172.21.15.139:0/3903891280 conn(0x7f5194060950 msgr2=0x7f519409d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:49.602 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.592+0000 7f5199ab9700 1 -- 172.21.15.139:0/3903891280 shutdown_connections 2020-02-12T14:12:49.602 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.592+0000 7f5199ab9700 1 -- 172.21.15.139:0/3903891280 wait complete. 2020-02-12T14:12:49.602 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.593+0000 7f5199ab9700 1 Processor -- start 2020-02-12T14:12:49.602 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.593+0000 7f5199ab9700 1 -- start start 2020-02-12T14:12:49.602 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.593+0000 7f5199ab9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f519412fac0 0x7f5194127d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:49.602 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.593+0000 7f5199ab9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519412e2e0 con 0x7f51940a3de0 2020-02-12T14:12:49.603 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.593+0000 7f5199ab9700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519412e580 con 0x7f519405ab20 2020-02-12T14:12:49.603 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.593+0000 7f5199ab9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51941394a0 con 0x7f519412fac0 2020-02-12T14:12:49.603 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.593+0000 7f51937fe700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f519405ab20 0x7f5194138d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35764/0 (socket says 172.21.15.139:35764) 2020-02-12T14:12:49.603 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.593+0000 7f51937fe700 1 -- 172.21.15.139:0/2468625710 learned_addr learned my addr 172.21.15.139:0/2468625710 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:49.603 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.593+0000 7f5193fff700 1 --2- 172.21.15.139:0/2468625710 >> v2:172.21.15.72:3300/0 conn(0x7f519412fac0 0x7f5194127d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:49.603 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.594+0000 7f51917fa700 1 -- 172.21.15.139:0/2468625710 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432757288 0 0) 0x7f519412e580 con 0x7f519405ab20 2020-02-12T14:12:49.603 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.594+0000 7f51917fa700 1 -- 172.21.15.139:0/2468625710 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5178002fe0 con 0x7f519405ab20 2020-02-12T14:12:49.603 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.594+0000 7f51917fa700 1 -- 172.21.15.139:0/2468625710 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731770195 0 0) 0x7f519412e2e0 con 0x7f51940a3de0 2020-02-12T14:12:49.604 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.594+0000 7f51917fa700 1 -- 172.21.15.139:0/2468625710 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f519412e580 con 0x7f51940a3de0 2020-02-12T14:12:49.604 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.594+0000 7f51917fa700 1 -- 172.21.15.139:0/2468625710 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2490437185 0 0) 0x7f5178002fe0 con 0x7f519405ab20 2020-02-12T14:12:49.604 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.594+0000 7f5193fff700 1 -- 172.21.15.139:0/2468625710 >> v1:172.21.15.139:6789/0 conn(0x7f519405ab20 legacy=0x7f5194138d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:49.604 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.594+0000 7f5193fff700 1 -- 172.21.15.139:0/2468625710 >> v1:172.21.15.72:6789/0 conn(0x7f51940a3de0 legacy=0x7f5194127610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:49.604 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.594+0000 7f5193fff700 1 -- 172.21.15.139:0/2468625710 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519412d680 con 0x7f519412fac0 2020-02-12T14:12:49.604 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.594+0000 7f5193fff700 1 --2- 172.21.15.139:0/2468625710 >> v2:172.21.15.72:3300/0 conn(0x7f519412fac0 0x7f5194127d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f51840010d0 tx=0x7f518c010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.604 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.594+0000 7f5193fff700 1 --2- 172.21.15.139:0/2468625710 >> v2:172.21.15.72:3300/0 conn(0x7f519412fac0 0x7f5194127d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f51840010d0 tx=0x7f518c010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.605 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.594+0000 7f5193fff700 1 --2- 172.21.15.139:0/2468625710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f519412fac0 0x7f5194127d20 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f51840010d0 tx=0x7f518c010e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:49.605 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.594+0000 7f5193fff700 1 --2- 172.21.15.139:0/2468625710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f519412fac0 0x7f5194127d20 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f51840010d0 tx=0x7f518c010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.605 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.594+0000 7f51917fa700 1 -- 172.21.15.139:0/2468625710 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5184001930 con 0x7f519412fac0 2020-02-12T14:12:49.605 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.594+0000 7f5193fff700 1 --2- 172.21.15.139:0/2468625710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f519412fac0 0x7f5194127d20 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f51840010d0 tx=0x7f518c010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.605 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.594+0000 7f5193fff700 1 --2- 172.21.15.139:0/2468625710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f519412fac0 0x7f5194127d20 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f51840010d0 tx=0x7f518c010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.605 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.594+0000 7f51917fa700 1 -- 172.21.15.139:0/2468625710 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518c00e350 con 0x7f519412fac0 2020-02-12T14:12:49.605 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.594+0000 7f5199ab9700 1 -- 172.21.15.139:0/2468625710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5194136f80 con 0x7f519412fac0 2020-02-12T14:12:49.605 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.594+0000 7f51917fa700 1 -- 172.21.15.139:0/2468625710 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f518c005c30 con 0x7f519412fac0 2020-02-12T14:12:49.606 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.594+0000 7f5199ab9700 1 -- 172.21.15.139:0/2468625710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519412a110 con 0x7f519412fac0 2020-02-12T14:12:49.606 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.595+0000 7f5193fff700 1 --2- 172.21.15.139:0/2468625710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f519412fac0 0x7f5194127d20 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f51840010d0 tx=0x7f518c010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.606 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.595+0000 7f5199ab9700 1 -- 172.21.15.139:0/2468625710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519412f350 con 0x7f519412fac0 2020-02-12T14:12:49.606 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.595+0000 7f51917fa700 1 -- 172.21.15.139:0/2468625710 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f518c00c900 con 0x7f519412fac0 2020-02-12T14:12:49.606 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.595+0000 7f5193fff700 1 --2- 172.21.15.139:0/2468625710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f519412fac0 0x7f5194127d20 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f51840010d0 tx=0x7f518c010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.606 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.595+0000 7f51917fa700 1 --2- 172.21.15.139:0/2468625710 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f517803a060 0x7f517803c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:49.606 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.595+0000 7f51917fa700 1 -- 172.21.15.139:0/2468625710 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f518c049620 con 0x7f519412fac0 2020-02-12T14:12:49.607 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.595+0000 7f51937fe700 1 --2- 172.21.15.139:0/2468625710 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f517803a060 0x7f517803c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:49.607 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.596+0000 7f51937fe700 1 --2- 172.21.15.139:0/2468625710 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f517803a060 0x7f517803c520 crc :-1 s=READY pgs=81 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:49.607 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.600+0000 7f5193fff700 1 --2- 172.21.15.139:0/2468625710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f519412fac0 0x7f5194127d20 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f51840010d0 tx=0x7f518c010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.607 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.600+0000 7f51917fa700 1 -- 172.21.15.139:0/2468625710 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f518c02ecb0 con 0x7f519412fac0 2020-02-12T14:12:49.734 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.732+0000 7f5199ab9700 1 -- 172.21.15.139:0/2468625710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5194067e20 con 0x7f519412fac0 2020-02-12T14:12:49.735 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.734+0000 7f5193fff700 1 --2- 172.21.15.139:0/2468625710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f519412fac0 0x7f5194127d20 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f51840010d0 tx=0x7f518c010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.735 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.734+0000 7f51917fa700 1 -- 172.21.15.139:0/2468625710 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f518c0317c0 con 0x7f519412fac0 2020-02-12T14:12:49.735 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 8 2020-02-12T14:12:49.736 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.734+0000 7f5199ab9700 1 -- 172.21.15.139:0/2468625710 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f517803a060 msgr2=0x7f517803c520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:49.737 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.734+0000 7f5199ab9700 1 --2- 172.21.15.139:0/2468625710 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f517803a060 0x7f517803c520 crc :-1 s=READY pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:49.737 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.734+0000 7f5199ab9700 1 -- 172.21.15.139:0/2468625710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f519412fac0 msgr2=0x7f5194127d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:49.737 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.734+0000 7f5199ab9700 1 --2- 172.21.15.139:0/2468625710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f519412fac0 0x7f5194127d20 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f51840010d0 tx=0x7f518c010e40).stop 2020-02-12T14:12:49.737 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.734+0000 7f5199ab9700 1 -- 172.21.15.139:0/2468625710 shutdown_connections 2020-02-12T14:12:49.737 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.734+0000 7f5199ab9700 1 --2- 172.21.15.139:0/2468625710 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f517803a060 0x7f517803c520 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:49.737 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.734+0000 7f5199ab9700 1 --2- 172.21.15.139:0/2468625710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f519412fac0 0x7f5194127d20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:49.738 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.734+0000 7f5199ab9700 1 -- 172.21.15.139:0/2468625710 >> 172.21.15.139:0/2468625710 conn(0x7f5194060950 msgr2=0x7f519405e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:49.738 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.734+0000 7f5199ab9700 1 -- 172.21.15.139:0/2468625710 shutdown_connections 2020-02-12T14:12:49.738 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.734+0000 7f5199ab9700 1 -- 172.21.15.139:0/2468625710 wait complete. 2020-02-12T14:12:49.747 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-02-12T14:12:49.854 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.853+0000 7fcdd8d68700 1 Processor -- start 2020-02-12T14:12:49.854 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.853+0000 7fcdd8d68700 1 -- start start 2020-02-12T14:12:49.861 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd8d68700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdd4135500 0x7fcdd40a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:49.861 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd8d68700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd41359e0 con 0x7fcdd40a21f0 2020-02-12T14:12:49.862 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd8d68700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd4135c80 con 0x7fcdd40a3f40 2020-02-12T14:12:49.862 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd8d68700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd40a18f0 con 0x7fcdd4135500 2020-02-12T14:12:49.862 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd259c700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fcdd40a3f40 0x7fcdd4134df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35772/0 (socket says 172.21.15.139:35772) 2020-02-12T14:12:49.862 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd259c700 1 -- 172.21.15.139:0/2198069891 learned_addr learned my addr 172.21.15.139:0/2198069891 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:49.862 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdc9d9b700 1 --2- 172.21.15.139:0/2198069891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdd4135500 0x7fcdd40a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:49.863 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd1d9b700 1 -- 172.21.15.139:0/2198069891 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2241088372 0 0) 0x7fcdd4135c80 con 0x7fcdd40a3f40 2020-02-12T14:12:49.863 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd1d9b700 1 -- 172.21.15.139:0/2198069891 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdb4003230 con 0x7fcdd40a3f40 2020-02-12T14:12:49.863 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd1d9b700 1 -- 172.21.15.139:0/2198069891 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176861720 0 0) 0x7fcdd41359e0 con 0x7fcdd40a21f0 2020-02-12T14:12:49.863 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd1d9b700 1 -- 172.21.15.139:0/2198069891 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdd4135c80 con 0x7fcdd40a21f0 2020-02-12T14:12:49.863 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd1d9b700 1 -- 172.21.15.139:0/2198069891 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1515987173 0 0) 0x7fcdb4003230 con 0x7fcdd40a3f40 2020-02-12T14:12:49.863 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd1d9b700 1 -- 172.21.15.139:0/2198069891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdd4135500 msgr2=0x7fcdd40a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:49.863 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd1d9b700 1 --2- 172.21.15.139:0/2198069891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdd4135500 0x7fcdd40a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:49.864 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd1d9b700 1 -- 172.21.15.139:0/2198069891 >> v1:172.21.15.72:6789/0 conn(0x7fcdd40a21f0 legacy=0x7fcdd412e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:49.864 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd1d9b700 1 -- 172.21.15.139:0/2198069891 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd40a2680 con 0x7fcdd40a3f40 2020-02-12T14:12:49.864 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd1d9b700 1 -- 172.21.15.139:0/2198069891 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7fcdc4001a50 con 0x7fcdd40a3f40 2020-02-12T14:12:49.864 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd1d9b700 1 -- 172.21.15.139:0/2198069891 >> v1:172.21.15.139:6789/0 conn(0x7fcdd40a3f40 legacy=0x7fcdd4134df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:49.864 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd1d9b700 1 --2- 172.21.15.139:0/2198069891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdb40038e0 0x7fcdb4003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:49.864 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd1d9b700 1 --2- 172.21.15.139:0/2198069891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdb40044d0 0x7fcdb4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:49.864 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd1d9b700 1 --2- 172.21.15.139:0/2198069891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdd4135500 0x7fcdb4004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:49.865 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd1d9b700 1 -- 172.21.15.139:0/2198069891 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd40a18f0 con 0x7fcdb40044d0 2020-02-12T14:12:49.865 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd1d9b700 1 -- 172.21.15.139:0/2198069891 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb4005210 con 0x7fcdb40038e0 2020-02-12T14:12:49.865 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd1d9b700 1 -- 172.21.15.139:0/2198069891 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb400b720 con 0x7fcdd4135500 2020-02-12T14:12:49.865 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd259c700 1 --2- 172.21.15.139:0/2198069891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdb40038e0 0x7fcdb4003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:49.865 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdc9d9b700 1 --2- 172.21.15.139:0/2198069891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdb40044d0 0x7fcdb4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:49.865 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd2d9d700 1 --2- 172.21.15.139:0/2198069891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdd4135500 0x7fcdb4004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:49.865 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd259c700 1 -- 172.21.15.139:0/2198069891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdd4135500 msgr2=0x7fcdb4004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:49.866 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd259c700 1 --2- 172.21.15.139:0/2198069891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdd4135500 0x7fcdb4004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:49.866 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd259c700 1 -- 172.21.15.139:0/2198069891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdb40044d0 msgr2=0x7fcdb4004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:49.866 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd259c700 1 --2- 172.21.15.139:0/2198069891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdb40044d0 0x7fcdb4004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:49.866 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd259c700 1 -- 172.21.15.139:0/2198069891 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb4003230 con 0x7fcdb40038e0 2020-02-12T14:12:49.866 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd2d9d700 1 --2- 172.21.15.139:0/2198069891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdd4135500 0x7fcdb4004db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T14:12:49.866 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd259c700 1 --2- 172.21.15.139:0/2198069891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdb40038e0 0x7fcdb4003ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcdc4001820 tx=0x7fcdd40a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.866 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd259c700 1 --2- 172.21.15.139:0/2198069891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdb40038e0 0x7fcdb4003ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcdc4001820 tx=0x7fcdd40a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.866 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd259c700 1 --2- 172.21.15.139:0/2198069891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdb40038e0 0x7fcdb4003ce0 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7fcdc4001820 tx=0x7fcdd40a2810).ready entity=mon.1 client_cookie=8d0549d278506a8b server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:49.867 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd259c700 1 --2- 172.21.15.139:0/2198069891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdb40038e0 0x7fcdb4003ce0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fcdc4001820 tx=0x7fcdd40a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.867 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd1d9b700 1 -- 172.21.15.139:0/2198069891 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdc400e540 con 0x7fcdb40038e0 2020-02-12T14:12:49.867 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd259c700 1 --2- 172.21.15.139:0/2198069891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdb40038e0 0x7fcdb4003ce0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fcdc4001820 tx=0x7fcdd40a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.867 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd1d9b700 1 -- 172.21.15.139:0/2198069891 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc400e6a0 con 0x7fcdb40038e0 2020-02-12T14:12:49.867 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd259c700 1 --2- 172.21.15.139:0/2198069891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdb40038e0 0x7fcdb4003ce0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fcdc4001820 tx=0x7fcdd40a2810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.867 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd1d9b700 1 -- 172.21.15.139:0/2198069891 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdc40100b0 con 0x7fcdb40038e0 2020-02-12T14:12:49.867 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd8d68700 1 -- 172.21.15.139:0/2198069891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdb40038e0 msgr2=0x7fcdb4003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:49.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd8d68700 1 --2- 172.21.15.139:0/2198069891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdb40038e0 0x7fcdb4003ce0 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7fcdc4001820 tx=0x7fcdd40a2810).stop 2020-02-12T14:12:49.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd2d9d700 1 -- 172.21.15.139:0/2198069891 reap_dead start 2020-02-12T14:12:49.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd8d68700 1 -- 172.21.15.139:0/2198069891 shutdown_connections 2020-02-12T14:12:49.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd8d68700 1 -- 172.21.15.139:0/2198069891 >> 172.21.15.139:0/2198069891 conn(0x7fcdd4060950 msgr2=0x7fcdd409d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:49.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd8d68700 1 -- 172.21.15.139:0/2198069891 shutdown_connections 2020-02-12T14:12:49.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.854+0000 7fcdd8d68700 1 -- 172.21.15.139:0/2198069891 wait complete. 2020-02-12T14:12:49.868 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.855+0000 7fcdd8d68700 1 Processor -- start 2020-02-12T14:12:49.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.855+0000 7fcdd8d68700 1 -- start start 2020-02-12T14:12:49.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.856+0000 7fcdd8d68700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fcdd4131c20 0x7fcdd4147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:49.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.856+0000 7fcdd8d68700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd4146c90 con 0x7fcdd41474b0 2020-02-12T14:12:49.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.856+0000 7fcdd8d68700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd4136af0 con 0x7fcdd40a0a00 2020-02-12T14:12:49.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.856+0000 7fcdd8d68700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd41320d0 con 0x7fcdd4131c20 2020-02-12T14:12:49.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.856+0000 7fcdd259c700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fcdd40a0a00 0x7fcdd4130580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35784/0 (socket says 172.21.15.139:35784) 2020-02-12T14:12:49.869 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.856+0000 7fcdd259c700 1 -- 172.21.15.139:0/3522309866 learned_addr learned my addr 172.21.15.139:0/3522309866 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:49.870 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.856+0000 7fcdc9d9b700 1 --2- 172.21.15.139:0/3522309866 >> v2:172.21.15.139:3300/0 conn(0x7fcdd4131c20 0x7fcdd4147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:49.870 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.856+0000 7fcdcbfff700 1 -- 172.21.15.139:0/3522309866 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 56727541 0 0) 0x7fcdd4136af0 con 0x7fcdd40a0a00 2020-02-12T14:12:49.870 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.856+0000 7fcdcbfff700 1 -- 172.21.15.139:0/3522309866 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdb8002fe0 con 0x7fcdd40a0a00 2020-02-12T14:12:49.870 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.856+0000 7fcdc9d9b700 1 -- 172.21.15.139:0/3522309866 >> v1:172.21.15.139:6789/0 conn(0x7fcdd40a0a00 legacy=0x7fcdd4130580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:49.870 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.856+0000 7fcdc9d9b700 1 -- 172.21.15.139:0/3522309866 >> v1:172.21.15.72:6789/0 conn(0x7fcdd41474b0 legacy=0x7fcdd414e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:49.870 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.856+0000 7fcdc9d9b700 1 -- 172.21.15.139:0/3522309866 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd4136d90 con 0x7fcdd4131c20 2020-02-12T14:12:49.870 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.856+0000 7fcdc9d9b700 1 --2- 172.21.15.139:0/3522309866 >> v2:172.21.15.139:3300/0 conn(0x7fcdd4131c20 0x7fcdd4147050 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcdbc007ed0 tx=0x7fcdbc010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.871 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.856+0000 7fcdc9d9b700 1 --2- 172.21.15.139:0/3522309866 >> v2:172.21.15.139:3300/0 conn(0x7fcdd4131c20 0x7fcdd4147050 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcdbc007ed0 tx=0x7fcdbc010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.871 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.856+0000 7fcdc9d9b700 1 --2- 172.21.15.139:0/3522309866 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdd4131c20 0x7fcdd4147050 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7fcdbc007ed0 tx=0x7fcdbc010b50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:49.871 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.857+0000 7fcdc9d9b700 1 --2- 172.21.15.139:0/3522309866 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdd4131c20 0x7fcdd4147050 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7fcdbc007ed0 tx=0x7fcdbc010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.871 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.857+0000 7fcdc9d9b700 1 --2- 172.21.15.139:0/3522309866 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdd4131c20 0x7fcdd4147050 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7fcdbc007ed0 tx=0x7fcdbc010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.871 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.857+0000 7fcdcbfff700 1 -- 172.21.15.139:0/3522309866 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdbc005e90 con 0x7fcdd4131c20 2020-02-12T14:12:49.871 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.857+0000 7fcdc9d9b700 1 --2- 172.21.15.139:0/3522309866 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdd4131c20 0x7fcdd4147050 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7fcdbc007ed0 tx=0x7fcdbc010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.871 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.857+0000 7fcdcbfff700 1 -- 172.21.15.139:0/3522309866 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdbc007160 con 0x7fcdd4131c20 2020-02-12T14:12:49.871 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.857+0000 7fcdcbfff700 1 -- 172.21.15.139:0/3522309866 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdbc007540 con 0x7fcdd4131c20 2020-02-12T14:12:49.872 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.857+0000 7fcdd8d68700 1 -- 172.21.15.139:0/3522309866 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd4137030 con 0x7fcdd4131c20 2020-02-12T14:12:49.872 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.857+0000 7fcdd8d68700 1 -- 172.21.15.139:0/3522309866 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd4130c90 con 0x7fcdd4131c20 2020-02-12T14:12:49.872 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.857+0000 7fcdc9d9b700 1 --2- 172.21.15.139:0/3522309866 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdd4131c20 0x7fcdd4147050 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7fcdbc007ed0 tx=0x7fcdbc010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.872 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.858+0000 7fcdcbfff700 1 -- 172.21.15.139:0/3522309866 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fcdbc0083f0 con 0x7fcdd4131c20 2020-02-12T14:12:49.872 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.858+0000 7fcdc9d9b700 1 --2- 172.21.15.139:0/3522309866 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdd4131c20 0x7fcdd4147050 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7fcdbc007ed0 tx=0x7fcdbc010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.872 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.858+0000 7fcdcbfff700 1 --2- 172.21.15.139:0/3522309866 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fcdb8039fa0 0x7fcdb803c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:49.873 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.858+0000 7fcdcbfff700 1 -- 172.21.15.139:0/3522309866 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fcdbc049930 con 0x7fcdd4131c20 2020-02-12T14:12:49.873 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.858+0000 7fcdd259c700 1 --2- 172.21.15.139:0/3522309866 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fcdb8039fa0 0x7fcdb803c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:49.873 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.858+0000 7fcdd8d68700 1 -- 172.21.15.139:0/3522309866 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd41371c0 con 0x7fcdd4131c20 2020-02-12T14:12:49.873 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.858+0000 7fcdd259c700 1 --2- 172.21.15.139:0/3522309866 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fcdb8039fa0 0x7fcdb803c460 crc :-1 s=READY pgs=82 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:49.873 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.861+0000 7fcdc9d9b700 1 --2- 172.21.15.139:0/3522309866 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdd4131c20 0x7fcdd4147050 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7fcdbc007ed0 tx=0x7fcdbc010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.874 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.861+0000 7fcdcbfff700 1 -- 172.21.15.139:0/3522309866 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fcdbc02ef40 con 0x7fcdd4131c20 2020-02-12T14:12:49.998 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.996+0000 7fcdd8d68700 1 -- 172.21.15.139:0/3522309866 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcdd4067e20 con 0x7fcdd4131c20 2020-02-12T14:12:49.999 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.996+0000 7fcdc9d9b700 1 --2- 172.21.15.139:0/3522309866 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdd4131c20 0x7fcdd4147050 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7fcdbc007ed0 tx=0x7fcdbc010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:49.999 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.996+0000 7fcdcbfff700 1 -- 172.21.15.139:0/3522309866 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7fcdbc031a10 con 0x7fcdd4131c20 2020-02-12T14:12:49.999 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 8 2020-02-12T14:12:50.000 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.997+0000 7fcdd8d68700 1 -- 172.21.15.139:0/3522309866 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fcdb8039fa0 msgr2=0x7fcdb803c460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:50.000 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.997+0000 7fcdd8d68700 1 --2- 172.21.15.139:0/3522309866 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fcdb8039fa0 0x7fcdb803c460 crc :-1 s=READY pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:50.000 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.997+0000 7fcdd8d68700 1 -- 172.21.15.139:0/3522309866 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdd4131c20 msgr2=0x7fcdd4147050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:50.000 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.997+0000 7fcdd8d68700 1 --2- 172.21.15.139:0/3522309866 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdd4131c20 0x7fcdd4147050 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7fcdbc007ed0 tx=0x7fcdbc010b50).stop 2020-02-12T14:12:50.001 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.997+0000 7fcdd8d68700 1 -- 172.21.15.139:0/3522309866 shutdown_connections 2020-02-12T14:12:50.001 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.997+0000 7fcdd8d68700 1 --2- 172.21.15.139:0/3522309866 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fcdb8039fa0 0x7fcdb803c460 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:50.001 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.997+0000 7fcdd8d68700 1 --2- 172.21.15.139:0/3522309866 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdd4131c20 0x7fcdd4147050 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:50.001 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.997+0000 7fcdd8d68700 1 -- 172.21.15.139:0/3522309866 >> 172.21.15.139:0/3522309866 conn(0x7fcdd4060950 msgr2=0x7fcdd405e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:50.001 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.998+0000 7fcdd8d68700 1 -- 172.21.15.139:0/3522309866 shutdown_connections 2020-02-12T14:12:50.001 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:49.998+0000 7fcdd8d68700 1 -- 172.21.15.139:0/3522309866 wait complete. 2020-02-12T14:12:50.010 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-02-12T14:12:50.116 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.114+0000 7f5318023700 1 Processor -- start 2020-02-12T14:12:50.116 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.115+0000 7f5318023700 1 -- start start 2020-02-12T14:12:50.121 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.115+0000 7f5318023700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53100a5a50 0x7f53101315b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:50.122 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.115+0000 7f5318023700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f5310131a10 0x7f531013ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:50.122 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.115+0000 7f5318023700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53100a2fb0 con 0x7f53100a7ac0 2020-02-12T14:12:50.122 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.115+0000 7f5318023700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53100a5eb0 con 0x7f5310131a10 2020-02-12T14:12:50.122 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.115+0000 7f5318023700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53100a60f0 con 0x7f53100a5a50 2020-02-12T14:12:50.122 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.115+0000 7f53165c0700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f5310131a10 0x7f531013ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:50.122 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.115+0000 7f53165c0700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f5310131a10 0x7f531013ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47158/0 (socket says 172.21.15.139:47158) 2020-02-12T14:12:50.122 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.115+0000 7f53165c0700 1 -- 172.21.15.139:0/3417266986 learned_addr learned my addr 172.21.15.139:0/3417266986 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:50.123 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.116+0000 7f53155be700 1 --2- 172.21.15.139:0/3417266986 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53100a5a50 0x7f53101315b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:50.123 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.116+0000 7f53165c0700 1 -- 172.21.15.139:0/3417266986 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53100a5a50 msgr2=0x7f53101315b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:50.123 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.116+0000 7f53165c0700 1 --2- 172.21.15.139:0/3417266986 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53100a5a50 0x7f53101315b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:50.123 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.116+0000 7f53165c0700 1 -- 172.21.15.139:0/3417266986 >> v1:172.21.15.72:6789/0 conn(0x7f53100a7ac0 legacy=0x7f53100a3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:50.123 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.116+0000 7f53165c0700 1 -- 172.21.15.139:0/3417266986 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53100a3680 con 0x7f5310131a10 2020-02-12T14:12:50.123 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.116+0000 7f53165c0700 1 --2- 172.21.15.139:0/3417266986 >> v2:172.21.15.139:3300/0 conn(0x7f5310131a10 0x7f531013ed90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f53080032b0 tx=0x7f5308008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.123 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.116+0000 7f53165c0700 1 --2- 172.21.15.139:0/3417266986 >> v2:172.21.15.139:3300/0 conn(0x7f5310131a10 0x7f531013ed90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f53080032b0 tx=0x7f5308008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.124 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.116+0000 7f53165c0700 1 --2- 172.21.15.139:0/3417266986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5310131a10 0x7f531013ed90 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f53080032b0 tx=0x7f5308008c60).ready entity=mon.1 client_cookie=304ea6d3361ae6d7 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:50.124 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.116+0000 7f53165c0700 1 --2- 172.21.15.139:0/3417266986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5310131a10 0x7f531013ed90 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f53080032b0 tx=0x7f5308008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.124 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.116+0000 7f5314dbd700 1 -- 172.21.15.139:0/3417266986 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53080110c0 con 0x7f5310131a10 2020-02-12T14:12:50.124 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.116+0000 7f53165c0700 1 --2- 172.21.15.139:0/3417266986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5310131a10 0x7f531013ed90 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f53080032b0 tx=0x7f5308008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.124 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.116+0000 7f5314dbd700 1 -- 172.21.15.139:0/3417266986 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5308011220 con 0x7f5310131a10 2020-02-12T14:12:50.124 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.116+0000 7f53165c0700 1 --2- 172.21.15.139:0/3417266986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5310131a10 0x7f531013ed90 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f53080032b0 tx=0x7f5308008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.124 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.116+0000 7f5314dbd700 1 -- 172.21.15.139:0/3417266986 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5308011600 con 0x7f5310131a10 2020-02-12T14:12:50.125 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.116+0000 7f5318023700 1 -- 172.21.15.139:0/3417266986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5310131a10 msgr2=0x7f531013ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:50.125 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.116+0000 7f5318023700 1 --2- 172.21.15.139:0/3417266986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5310131a10 0x7f531013ed90 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f53080032b0 tx=0x7f5308008c60).stop 2020-02-12T14:12:50.125 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.116+0000 7f5318023700 1 -- 172.21.15.139:0/3417266986 shutdown_connections 2020-02-12T14:12:50.125 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.116+0000 7f5318023700 1 --2- 172.21.15.139:0/3417266986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5310131a10 0x7f531013ed90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:50.125 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.116+0000 7f5318023700 1 --2- 172.21.15.139:0/3417266986 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53100a5a50 0x7f53101315b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:50.126 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.116+0000 7f5318023700 1 -- 172.21.15.139:0/3417266986 >> 172.21.15.139:0/3417266986 conn(0x7f5310060950 msgr2=0x7f531009d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:50.126 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.117+0000 7f5318023700 1 -- 172.21.15.139:0/3417266986 shutdown_connections 2020-02-12T14:12:50.126 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.117+0000 7f5318023700 1 -- 172.21.15.139:0/3417266986 wait complete. 2020-02-12T14:12:50.126 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.117+0000 7f5318023700 1 Processor -- start 2020-02-12T14:12:50.126 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.117+0000 7f5318023700 1 -- start start 2020-02-12T14:12:50.126 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.118+0000 7f5318023700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53100a5a50 0x7f5310062c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:50.126 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.118+0000 7f5318023700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5310062830 con 0x7f53100a7ac0 2020-02-12T14:12:50.126 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.118+0000 7f5318023700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5310066d30 con 0x7f5310131a10 2020-02-12T14:12:50.127 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.118+0000 7f5318023700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5310066fd0 con 0x7f53100a5a50 2020-02-12T14:12:50.127 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.118+0000 7f53165c0700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f5310131a10 0x7f531014dcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35802/0 (socket says 172.21.15.139:35802) 2020-02-12T14:12:50.127 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.118+0000 7f53165c0700 1 -- 172.21.15.139:0/792189653 learned_addr learned my addr 172.21.15.139:0/792189653 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:50.127 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.118+0000 7f5315dbf700 1 --2- 172.21.15.139:0/792189653 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53100a5a50 0x7f5310062c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:50.127 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.118+0000 7f52feffd700 1 -- 172.21.15.139:0/792189653 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 840564485 0 0) 0x7f5310066d30 con 0x7f5310131a10 2020-02-12T14:12:50.127 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.118+0000 7f52feffd700 1 -- 172.21.15.139:0/792189653 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52f0002fe0 con 0x7f5310131a10 2020-02-12T14:12:50.128 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.118+0000 7f52feffd700 1 -- 172.21.15.139:0/792189653 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3853234029 0 0) 0x7f5310062830 con 0x7f53100a7ac0 2020-02-12T14:12:50.128 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f52feffd700 1 -- 172.21.15.139:0/792189653 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5310066d30 con 0x7f53100a7ac0 2020-02-12T14:12:50.128 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f52feffd700 1 -- 172.21.15.139:0/792189653 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2069908425 0 0) 0x7f52f0002fe0 con 0x7f5310131a10 2020-02-12T14:12:50.128 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f52feffd700 1 -- 172.21.15.139:0/792189653 --> v1:172.21.15.139:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5310062830 con 0x7f5310131a10 2020-02-12T14:12:50.128 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f52feffd700 1 -- 172.21.15.139:0/792189653 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7f5308010d70 con 0x7f5310131a10 2020-02-12T14:12:50.128 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f52feffd700 1 -- 172.21.15.139:0/792189653 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53100a5a50 msgr2=0x7f5310062c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:50.129 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f52feffd700 1 --2- 172.21.15.139:0/792189653 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53100a5a50 0x7f5310062c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:50.129 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f52feffd700 1 -- 172.21.15.139:0/792189653 >> v1:172.21.15.139:6789/0 conn(0x7f5310131a10 legacy=0x7f531014dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:50.129 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f52feffd700 1 -- 172.21.15.139:0/792189653 >> v1:172.21.15.72:6789/0 conn(0x7f53100a7ac0 legacy=0x7f5310146ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:50.129 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f52feffd700 1 --2- 172.21.15.139:0/792189653 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52f0004b20 0x7f52f0004f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:50.129 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f52feffd700 1 --2- 172.21.15.139:0/792189653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52f0003800 0x7f52f0003c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:50.129 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f52feffd700 1 --2- 172.21.15.139:0/792189653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52f00040c0 0x7f52f0014350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:50.129 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f52feffd700 1 -- 172.21.15.139:0/792189653 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5310066fd0 con 0x7f52f00040c0 2020-02-12T14:12:50.130 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f52feffd700 1 -- 172.21.15.139:0/792189653 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f0004570 con 0x7f52f0003800 2020-02-12T14:12:50.130 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f52feffd700 1 -- 172.21.15.139:0/792189653 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f0009740 con 0x7f52f0004b20 2020-02-12T14:12:50.130 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f5315dbf700 1 --2- 172.21.15.139:0/792189653 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53100a5a50 0x7f5310062c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T14:12:50.130 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f53155be700 1 --2- 172.21.15.139:0/792189653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52f0003800 0x7f52f0003c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:50.130 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f53165c0700 1 --2- 172.21.15.139:0/792189653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52f00040c0 0x7f52f0014350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:50.130 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f5315dbf700 1 --2- 172.21.15.139:0/792189653 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52f0004b20 0x7f52f0004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:50.130 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f53155be700 1 -- 172.21.15.139:0/792189653 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52f0004b20 msgr2=0x7f52f0004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:50.131 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f53155be700 1 --2- 172.21.15.139:0/792189653 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52f0004b20 0x7f52f0004f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:50.131 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f53155be700 1 -- 172.21.15.139:0/792189653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52f00040c0 msgr2=0x7f52f0014350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:50.131 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f53155be700 1 --2- 172.21.15.139:0/792189653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52f00040c0 0x7f52f0014350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:50.131 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f53155be700 1 -- 172.21.15.139:0/792189653 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5310061e70 con 0x7f52f0003800 2020-02-12T14:12:50.131 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f5318023700 1 -- 172.21.15.139:0/792189653 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5310140b40 con 0x7f52f0003800 2020-02-12T14:12:50.131 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f53155be700 1 --2- 172.21.15.139:0/792189653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52f0003800 0x7f52f0003c60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f530c002ef0 tx=0x7f530c010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.131 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f5318023700 1 -- 172.21.15.139:0/792189653 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5310066890 con 0x7f52f0003800 2020-02-12T14:12:50.132 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f53155be700 1 --2- 172.21.15.139:0/792189653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52f0003800 0x7f52f0003c60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f530c002ef0 tx=0x7f530c010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.132 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f53155be700 1 --2- 172.21.15.139:0/792189653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52f0003800 0x7f52f0003c60 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7f530c002ef0 tx=0x7f530c010dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:50.132 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f53155be700 1 --2- 172.21.15.139:0/792189653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52f0003800 0x7f52f0003c60 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f530c002ef0 tx=0x7f530c010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.132 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f52feffd700 1 -- 172.21.15.139:0/792189653 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f530c012b10 con 0x7f52f0003800 2020-02-12T14:12:50.132 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f53155be700 1 --2- 172.21.15.139:0/792189653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52f0003800 0x7f52f0003c60 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f530c002ef0 tx=0x7f530c010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.132 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f52feffd700 1 -- 172.21.15.139:0/792189653 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530c012cb0 con 0x7f52f0003800 2020-02-12T14:12:50.132 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f53155be700 1 --2- 172.21.15.139:0/792189653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52f0003800 0x7f52f0003c60 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f530c002ef0 tx=0x7f530c010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.132 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.119+0000 7f52feffd700 1 -- 172.21.15.139:0/792189653 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f530c012e20 con 0x7f52f0003800 2020-02-12T14:12:50.133 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.120+0000 7f53155be700 1 --2- 172.21.15.139:0/792189653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52f0003800 0x7f52f0003c60 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f530c002ef0 tx=0x7f530c010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.133 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.120+0000 7f52feffd700 1 -- 172.21.15.139:0/792189653 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f530c0058b0 con 0x7f52f0003800 2020-02-12T14:12:50.133 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.120+0000 7f53155be700 1 --2- 172.21.15.139:0/792189653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52f0003800 0x7f52f0003c60 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f530c002ef0 tx=0x7f530c010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.133 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.120+0000 7f52feffd700 1 --2- 172.21.15.139:0/792189653 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f52f004adc0 0x7f52f004d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:50.133 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.120+0000 7f5318023700 1 -- 172.21.15.139:0/792189653 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5310066ba0 con 0x7f52f0003800 2020-02-12T14:12:50.133 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.120+0000 7f52feffd700 1 -- 172.21.15.139:0/792189653 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f530c04a160 con 0x7f52f0003800 2020-02-12T14:12:50.134 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.120+0000 7f5315dbf700 1 --2- 172.21.15.139:0/792189653 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f52f004adc0 0x7f52f004d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:50.134 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.120+0000 7f5315dbf700 1 --2- 172.21.15.139:0/792189653 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f52f004adc0 0x7f52f004d280 crc :-1 s=READY pgs=83 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:50.134 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.124+0000 7f53155be700 1 --2- 172.21.15.139:0/792189653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52f0003800 0x7f52f0003c60 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f530c002ef0 tx=0x7f530c010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.134 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.124+0000 7f52feffd700 1 -- 172.21.15.139:0/792189653 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f530c02f660 con 0x7f52f0003800 2020-02-12T14:12:50.303 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.301+0000 7f5318023700 1 -- 172.21.15.139:0/792189653 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53100629c0 con 0x7f52f0003800 2020-02-12T14:12:50.303 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.301+0000 7f53155be700 1 --2- 172.21.15.139:0/792189653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52f0003800 0x7f52f0003c60 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f530c002ef0 tx=0x7f530c010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.303 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.301+0000 7f52feffd700 1 -- 172.21.15.139:0/792189653 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2137 (secure 0 0 0) 0x7f53100629c0 con 0x7f52f0003800 2020-02-12T14:12:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:12:50.303 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/4257142488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":4257142488},{"type":"v1","addr":"172.21.15.72:6833","nonce":4257142488}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-02-12T14:12:39.448075+0000","modified":"2020-02-12T14:12:43.142032+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.139:6835/2764306457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2764306457},{"type":"v1","addr":"172.21.15.139:6835","nonce":2764306457}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-02-12T14:12:50.304 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.303+0000 7f5318023700 1 -- 172.21.15.139:0/792189653 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f52f004adc0 msgr2=0x7f52f004d280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:50.305 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.303+0000 7f5318023700 1 --2- 172.21.15.139:0/792189653 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f52f004adc0 0x7f52f004d280 crc :-1 s=READY pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:50.305 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.303+0000 7f5318023700 1 -- 172.21.15.139:0/792189653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52f0003800 msgr2=0x7f52f0003c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:50.305 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.303+0000 7f5318023700 1 --2- 172.21.15.139:0/792189653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52f0003800 0x7f52f0003c60 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7f530c002ef0 tx=0x7f530c010dc0).stop 2020-02-12T14:12:50.305 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.303+0000 7f53165c0700 1 -- 172.21.15.139:0/792189653 reap_dead start 2020-02-12T14:12:50.305 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.303+0000 7f53165c0700 1 -- 172.21.15.139:0/792189653 reap_dead start 2020-02-12T14:12:50.305 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.303+0000 7f5318023700 1 -- 172.21.15.139:0/792189653 shutdown_connections 2020-02-12T14:12:50.306 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.303+0000 7f5318023700 1 -- 172.21.15.139:0/792189653 >> 172.21.15.139:0/792189653 conn(0x7f5310060950 msgr2=0x7f531005e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:50.306 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.303+0000 7f5318023700 1 -- 172.21.15.139:0/792189653 shutdown_connections 2020-02-12T14:12:50.306 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.303+0000 7f5318023700 1 -- 172.21.15.139:0/792189653 wait complete. 2020-02-12T14:12:50.306 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 6 2020-02-12T14:12:50.516 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4378}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 6, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [3], u'info': {u'gid_4378': {u'export_targets': [], u'name': u'a', u'incarnation': 5, u'state_seq': 2, u'state': u'up:active', u'gid': 4378, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 2764306457, u'type': u'v2', u'addr': u'172.21.15.139:6834'}, {u'nonce': 2764306457, u'type': u'v1', u'addr': u'172.21.15.139:6835'}]}, u'addr': u'172.21.15.139:6835/2764306457'}}, u'fs_name': u'cephfs', u'created': u'2020-02-12T14:12:39.448075+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-02-12T14:12:43.142032+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-02-12T14:12:50.516 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-02-12T14:12:50.516 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-02-12T14:12:50.634 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2020-02-12T14:12:50.634 INFO:teuthology.orchestra.run.smithi139.stdout: "cluster_fsid": "dacc9a6c-9e88-46ac-940b-c4a329dbffec", 2020-02-12T14:12:50.635 INFO:teuthology.orchestra.run.smithi139.stdout: "whoami": 0, 2020-02-12T14:12:50.635 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4378, 2020-02-12T14:12:50.635 INFO:teuthology.orchestra.run.smithi139.stdout: "want_state": "up:active", 2020-02-12T14:12:50.635 INFO:teuthology.orchestra.run.smithi139.stdout: "state": "up:active", 2020-02-12T14:12:50.635 INFO:teuthology.orchestra.run.smithi139.stdout: "rank_uptime": 8.4908326069999998, 2020-02-12T14:12:50.635 INFO:teuthology.orchestra.run.smithi139.stdout: "mdsmap_epoch": 6, 2020-02-12T14:12:50.635 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch": 23, 2020-02-12T14:12:50.636 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch_barrier": 23, 2020-02-12T14:12:50.636 INFO:teuthology.orchestra.run.smithi139.stdout: "uptime": 8.8351393760000008 2020-02-12T14:12:50.636 INFO:teuthology.orchestra.run.smithi139.stdout:} 2020-02-12T14:12:50.647 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "dacc9a6c-9e88-46ac-940b-c4a329dbffec", "whoami": 0, "id": 4378, "want_state": "up:active", "state": "up:active", "rank_uptime": 8.4908326069999998, "mdsmap_epoch": 6, "osdmap_epoch": 23, "osdmap_epoch_barrier": 23, "uptime": 8.8351393760000008 } 2020-02-12T14:12:50.647 INFO:teuthology.run_tasks:Running task exec... 2020-02-12T14:12:50.660 INFO:teuthology.task.exec:Executing custom commands... 2020-02-12T14:12:50.660 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi139.front.sepia.ceph.com 2020-02-12T14:12:50.660 INFO:teuthology.orchestra.run.smithi139:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2020-02-12T14:12:50.785 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.777+0000 7fc17c79a700 1 Processor -- start 2020-02-12T14:12:50.785 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.777+0000 7fc17c79a700 1 -- start start 2020-02-12T14:12:50.785 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.778+0000 7fc17c79a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc1740a1970 0x7fc17407f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:50.785 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.778+0000 7fc17c79a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1740a2b30 con 0x7fc17407f6f0 2020-02-12T14:12:50.786 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.778+0000 7fc17c79a700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17405c200 con 0x7fc1740a1590 2020-02-12T14:12:50.786 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.778+0000 7fc17c79a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1740a3070 con 0x7fc1740a1970 2020-02-12T14:12:50.786 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.778+0000 7fc17ad37700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fc1740a1590 0x7fc1740a3510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35812/0 (socket says 172.21.15.139:35812) 2020-02-12T14:12:50.786 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.778+0000 7fc17ad37700 1 -- 172.21.15.139:0/3947959253 learned_addr learned my addr 172.21.15.139:0/3947959253 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:50.786 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.778+0000 7fc179d35700 1 -- 172.21.15.139:0/3947959253 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278904650 0 0) 0x7fc17405c200 con 0x7fc1740a1590 2020-02-12T14:12:50.786 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.778+0000 7fc179d35700 1 -- 172.21.15.139:0/3947959253 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc160003230 con 0x7fc1740a1590 2020-02-12T14:12:50.786 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.778+0000 7fc17a536700 1 --2- 172.21.15.139:0/3947959253 >> v2:172.21.15.72:3300/0 conn(0x7fc1740a1970 0x7fc17407f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:50.787 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc179d35700 1 -- 172.21.15.139:0/3947959253 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1607893663 0 0) 0x7fc160003230 con 0x7fc1740a1590 2020-02-12T14:12:50.787 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc179d35700 1 -- 172.21.15.139:0/3947959253 >> v2:172.21.15.72:3300/0 conn(0x7fc1740a1970 msgr2=0x7fc17407f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:50.787 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc179d35700 1 --2- 172.21.15.139:0/3947959253 >> v2:172.21.15.72:3300/0 conn(0x7fc1740a1970 0x7fc17407f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:50.787 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc179d35700 1 -- 172.21.15.139:0/3947959253 >> v1:172.21.15.72:6789/0 conn(0x7fc17407f6f0 legacy=0x7fc17414f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:50.787 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc179d35700 1 -- 172.21.15.139:0/3947959253 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17405c8a0 con 0x7fc1740a1590 2020-02-12T14:12:50.787 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc179d35700 1 -- 172.21.15.139:0/3947959253 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7fc170001a50 con 0x7fc1740a1590 2020-02-12T14:12:50.787 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc179d35700 1 -- 172.21.15.139:0/3947959253 >> v1:172.21.15.139:6789/0 conn(0x7fc1740a1590 legacy=0x7fc1740a3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:50.788 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc179d35700 1 --2- 172.21.15.139:0/3947959253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc160003720 0x7fc160003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:50.788 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc179d35700 1 --2- 172.21.15.139:0/3947959253 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1600044d0 0x7fc160004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:50.788 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc179d35700 1 --2- 172.21.15.139:0/3947959253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc160004db0 0x7fc16000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:50.788 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc179d35700 1 -- 172.21.15.139:0/3947959253 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740a3070 con 0x7fc160003720 2020-02-12T14:12:50.788 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc179d35700 1 -- 172.21.15.139:0/3947959253 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1600041c0 con 0x7fc160004db0 2020-02-12T14:12:50.788 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc179d35700 1 -- 172.21.15.139:0/3947959253 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16004fb90 con 0x7fc1600044d0 2020-02-12T14:12:50.788 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc17b538700 1 --2- 172.21.15.139:0/3947959253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc160004db0 0x7fc16000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:50.788 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc17ad37700 1 --2- 172.21.15.139:0/3947959253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc160003720 0x7fc160003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:50.789 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc17a536700 1 --2- 172.21.15.139:0/3947959253 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1600044d0 0x7fc160004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:50.789 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc17b538700 1 -- 172.21.15.139:0/3947959253 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1600044d0 msgr2=0x7fc160004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:50.789 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc17b538700 1 --2- 172.21.15.139:0/3947959253 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1600044d0 0x7fc160004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:50.789 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc17b538700 1 -- 172.21.15.139:0/3947959253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc160003720 msgr2=0x7fc160003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:50.789 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc17b538700 1 --2- 172.21.15.139:0/3947959253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc160003720 0x7fc160003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:50.789 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc17b538700 1 -- 172.21.15.139:0/3947959253 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc160003230 con 0x7fc160004db0 2020-02-12T14:12:50.789 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc17b538700 1 --2- 172.21.15.139:0/3947959253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc160004db0 0x7fc16000b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc1600054a0 tx=0x7fc16c00fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.790 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc17b538700 1 -- 172.21.15.139:0/3947959253 reap_dead start 2020-02-12T14:12:50.790 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc17b538700 1 --2- 172.21.15.139:0/3947959253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc160004db0 0x7fc16000b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc1600054a0 tx=0x7fc16c00fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.790 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc17b538700 1 --2- 172.21.15.139:0/3947959253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc160004db0 0x7fc16000b720 secure :-1 s=READY pgs=198 cs=0 l=1 rx=0x7fc1600054a0 tx=0x7fc16c00fd50).ready entity=mon.1 client_cookie=2abb94e3d76a650a server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:50.790 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc17b538700 1 --2- 172.21.15.139:0/3947959253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc160004db0 0x7fc16000b720 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7fc1600054a0 tx=0x7fc16c00fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.790 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc179d35700 1 -- 172.21.15.139:0/3947959253 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc16c003540 con 0x7fc160004db0 2020-02-12T14:12:50.790 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc17b538700 1 --2- 172.21.15.139:0/3947959253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc160004db0 0x7fc16000b720 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7fc1600054a0 tx=0x7fc16c00fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.790 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc17b538700 1 --2- 172.21.15.139:0/3947959253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc160004db0 0x7fc16000b720 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7fc1600054a0 tx=0x7fc16c00fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.791 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc179d35700 1 -- 172.21.15.139:0/3947959253 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c0036a0 con 0x7fc160004db0 2020-02-12T14:12:50.791 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc179d35700 1 -- 172.21.15.139:0/3947959253 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc16c003a00 con 0x7fc160004db0 2020-02-12T14:12:50.791 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc17c79a700 1 -- 172.21.15.139:0/3947959253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc160004db0 msgr2=0x7fc16000b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:50.792 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.779+0000 7fc17c79a700 1 --2- 172.21.15.139:0/3947959253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc160004db0 0x7fc16000b720 secure :-1 s=READY pgs=198 cs=0 l=1 rx=0x7fc1600054a0 tx=0x7fc16c00fd50).stop 2020-02-12T14:12:50.792 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.780+0000 7fc17c79a700 1 -- 172.21.15.139:0/3947959253 shutdown_connections 2020-02-12T14:12:50.792 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.780+0000 7fc17c79a700 1 --2- 172.21.15.139:0/3947959253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc160004db0 0x7fc16000b720 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:50.793 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.780+0000 7fc17c79a700 1 -- 172.21.15.139:0/3947959253 >> 172.21.15.139:0/3947959253 conn(0x7fc1740aacf0 msgr2=0x7fc1740a6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:50.793 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.780+0000 7fc17c79a700 1 -- 172.21.15.139:0/3947959253 shutdown_connections 2020-02-12T14:12:50.793 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.780+0000 7fc17c79a700 1 -- 172.21.15.139:0/3947959253 wait complete. 2020-02-12T14:12:50.793 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.781+0000 7fc17c79a700 1 Processor -- start 2020-02-12T14:12:50.793 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.781+0000 7fc17c79a700 1 -- start start 2020-02-12T14:12:50.793 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.781+0000 7fc17c79a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc160004db0 0x7fc17409d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:50.794 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.782+0000 7fc17c79a700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc17409d4e0 0x7fc1740a89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:50.794 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.782+0000 7fc17c79a700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17405a8a0 con 0x7fc1740662d0 2020-02-12T14:12:50.794 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.782+0000 7fc17c79a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1740a48c0 con 0x7fc160004db0 2020-02-12T14:12:50.794 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.782+0000 7fc17c79a700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17409e440 con 0x7fc17409d4e0 2020-02-12T14:12:50.794 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.782+0000 7fc17a536700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc17409d4e0 0x7fc1740a89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:50.794 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.782+0000 7fc17b538700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fc1740662d0 0x7fc1740a8e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35824/0 (socket says 172.21.15.139:35824) 2020-02-12T14:12:50.795 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.782+0000 7fc17b538700 1 -- 172.21.15.139:0/2762184845 learned_addr learned my addr 172.21.15.139:0/2762184845 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:50.795 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.782+0000 7fc17ad37700 1 --2- 172.21.15.139:0/2762184845 >> v2:172.21.15.72:3300/0 conn(0x7fc160004db0 0x7fc17409d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:50.795 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.782+0000 7fc17a536700 1 -- 172.21.15.139:0/2762184845 >> v2:172.21.15.72:3300/0 conn(0x7fc160004db0 msgr2=0x7fc17409d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:50.795 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.782+0000 7fc17a536700 1 --2- 172.21.15.139:0/2762184845 >> v2:172.21.15.72:3300/0 conn(0x7fc160004db0 0x7fc17409d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:50.795 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.782+0000 7fc17a536700 1 -- 172.21.15.139:0/2762184845 >> v1:172.21.15.139:6789/0 conn(0x7fc1740662d0 legacy=0x7fc1740a8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:50.795 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.782+0000 7fc16b7fe700 1 -- 172.21.15.139:0/2762184845 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195722351 0 0) 0x7fc17405a8a0 con 0x7fc1740662d0 2020-02-12T14:12:50.795 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.782+0000 7fc17a536700 1 -- 172.21.15.139:0/2762184845 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17409e210 con 0x7fc17409d4e0 2020-02-12T14:12:50.796 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.782+0000 7fc17a536700 1 --2- 172.21.15.139:0/2762184845 >> v2:172.21.15.139:3300/0 conn(0x7fc17409d4e0 0x7fc1740a89b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc164002f30 tx=0x7fc164010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.796 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.782+0000 7fc17a536700 1 --2- 172.21.15.139:0/2762184845 >> v2:172.21.15.139:3300/0 conn(0x7fc17409d4e0 0x7fc1740a89b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc164002f30 tx=0x7fc164010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.796 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.782+0000 7fc17a536700 1 --2- 172.21.15.139:0/2762184845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc17409d4e0 0x7fc1740a89b0 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7fc164002f30 tx=0x7fc164010b50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:50.796 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.782+0000 7fc17a536700 1 --2- 172.21.15.139:0/2762184845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc17409d4e0 0x7fc1740a89b0 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7fc164002f30 tx=0x7fc164010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.796 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.782+0000 7fc17a536700 1 --2- 172.21.15.139:0/2762184845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc17409d4e0 0x7fc1740a89b0 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7fc164002f30 tx=0x7fc164010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.796 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.782+0000 7fc16b7fe700 1 -- 172.21.15.139:0/2762184845 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc164005e90 con 0x7fc17409d4e0 2020-02-12T14:12:50.796 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.782+0000 7fc17a536700 1 --2- 172.21.15.139:0/2762184845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc17409d4e0 0x7fc1740a89b0 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7fc164002f30 tx=0x7fc164010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.797 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.782+0000 7fc16b7fe700 1 -- 172.21.15.139:0/2762184845 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc164007160 con 0x7fc17409d4e0 2020-02-12T14:12:50.797 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.782+0000 7fc16b7fe700 1 -- 172.21.15.139:0/2762184845 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc164007540 con 0x7fc17409d4e0 2020-02-12T14:12:50.797 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.782+0000 7fc17c79a700 1 -- 172.21.15.139:0/2762184845 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17409e6e0 con 0x7fc17409d4e0 2020-02-12T14:12:50.797 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.782+0000 7fc17c79a700 1 -- 172.21.15.139:0/2762184845 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc174066cd0 con 0x7fc17409d4e0 2020-02-12T14:12:50.797 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.783+0000 7fc17a536700 1 --2- 172.21.15.139:0/2762184845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc17409d4e0 0x7fc1740a89b0 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7fc164002f30 tx=0x7fc164010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.797 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.783+0000 7fc16b7fe700 1 -- 172.21.15.139:0/2762184845 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fc164008410 con 0x7fc17409d4e0 2020-02-12T14:12:50.798 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.783+0000 7fc17a536700 1 --2- 172.21.15.139:0/2762184845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc17409d4e0 0x7fc1740a89b0 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7fc164002f30 tx=0x7fc164010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.798 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.783+0000 7fc16b7fe700 1 --2- 172.21.15.139:0/2762184845 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fc15c039b50 0x7fc15c03c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:50.798 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.783+0000 7fc16b7fe700 1 -- 172.21.15.139:0/2762184845 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fc164049890 con 0x7fc17409d4e0 2020-02-12T14:12:50.798 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.783+0000 7fc17c79a700 1 -- 172.21.15.139:0/2762184845 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc17409ec70 con 0x7fc17409d4e0 2020-02-12T14:12:50.798 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.783+0000 7fc17ad37700 1 --2- 172.21.15.139:0/2762184845 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fc15c039b50 0x7fc15c03c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:50.798 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.784+0000 7fc17ad37700 1 --2- 172.21.15.139:0/2762184845 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fc15c039b50 0x7fc15c03c010 crc :-1 s=READY pgs=84 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:50.799 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.787+0000 7fc17a536700 1 --2- 172.21.15.139:0/2762184845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc17409d4e0 0x7fc1740a89b0 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7fc164002f30 tx=0x7fc164010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:50.799 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.787+0000 7fc16b7fe700 1 -- 172.21.15.139:0/2762184845 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fc16402eec0 con 0x7fc17409d4e0 2020-02-12T14:12:50.967 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:50.966+0000 7fc17c79a700 1 -- 172.21.15.139:0/2762184845 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc1740565b0 con 0x7fc17409d4e0 2020-02-12T14:12:51.173 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.172+0000 7fc17a536700 1 --2- 172.21.15.139:0/2762184845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc17409d4e0 0x7fc1740a89b0 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7fc164002f30 tx=0x7fc164010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.173 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.172+0000 7fc16b7fe700 1 -- 172.21.15.139:0/2762184845 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v7) v1 ==== 168+0+0 (secure 0 0 0) 0x7fc164031970 con 0x7fc17409d4e0 2020-02-12T14:12:51.175 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.174+0000 7fc17c79a700 1 -- 172.21.15.139:0/2762184845 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fc15c039b50 msgr2=0x7fc15c03c010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:51.176 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.174+0000 7fc17c79a700 1 --2- 172.21.15.139:0/2762184845 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fc15c039b50 0x7fc15c03c010 crc :-1 s=READY pgs=84 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:51.176 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.174+0000 7fc17c79a700 1 -- 172.21.15.139:0/2762184845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc17409d4e0 msgr2=0x7fc1740a89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:51.176 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.174+0000 7fc17c79a700 1 --2- 172.21.15.139:0/2762184845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc17409d4e0 0x7fc1740a89b0 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7fc164002f30 tx=0x7fc164010b50).stop 2020-02-12T14:12:51.176 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.174+0000 7fc17c79a700 1 -- 172.21.15.139:0/2762184845 shutdown_connections 2020-02-12T14:12:51.176 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.174+0000 7fc17c79a700 1 --2- 172.21.15.139:0/2762184845 >> v2:172.21.15.72:3300/0 conn(0x7fc160004db0 0x7fc17409d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:51.176 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.174+0000 7fc17c79a700 1 --2- 172.21.15.139:0/2762184845 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fc15c039b50 0x7fc15c03c010 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:51.176 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.174+0000 7fc17c79a700 1 --2- 172.21.15.139:0/2762184845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc17409d4e0 0x7fc1740a89b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:51.177 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.174+0000 7fc17c79a700 1 -- 172.21.15.139:0/2762184845 >> 172.21.15.139:0/2762184845 conn(0x7fc1740aacf0 msgr2=0x7fc1740a8190 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:51.177 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.174+0000 7fc17c79a700 1 -- 172.21.15.139:0/2762184845 shutdown_connections 2020-02-12T14:12:51.177 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.174+0000 7fc17c79a700 1 -- 172.21.15.139:0/2762184845 wait complete. 2020-02-12T14:12:51.177 INFO:teuthology.orchestra.run.smithi139.stderr:inline data enabled 2020-02-12T14:12:51.186 INFO:teuthology.run_tasks:Running task ceph-fuse... 2020-02-12T14:12:51.205 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2020-02-12T14:12:51.205 INFO:tasks.ceph_fuse:config is None 2020-02-12T14:12:51.205 INFO:tasks.ceph_fuse:new config is {'client.0': None} 2020-02-12T14:12:51.206 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2020-02-12T14:12:51.206 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-12T14:12:51.312 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.311+0000 7fbee69a0700 1 Processor -- start 2020-02-12T14:12:51.312 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.311+0000 7fbee69a0700 1 -- start start 2020-02-12T14:12:51.320 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.311+0000 7fbee69a0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbee00a7080 0x7fbee00a3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:51.320 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.311+0000 7fbee69a0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbee00a36e0 0x7fbee009f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:51.320 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.311+0000 7fbee69a0700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbee009f680 0x7fbee009faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:51.320 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.311+0000 7fbee69a0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee009e3b0 con 0x7fbee00a7080 2020-02-12T14:12:51.320 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.311+0000 7fbee69a0700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee009e7e0 con 0x7fbee009f680 2020-02-12T14:12:51.321 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.311+0000 7fbee69a0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee009ea80 con 0x7fbee00a36e0 2020-02-12T14:12:51.321 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.311+0000 7fbee619f700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbee009f680 0x7fbee009faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:51.321 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.312+0000 7fbee619f700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbee009f680 0x7fbee009faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47192/0 (socket says 172.21.15.139:47192) 2020-02-12T14:12:51.321 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.312+0000 7fbee619f700 1 -- 172.21.15.139:0/3688052934 learned_addr learned my addr 172.21.15.139:0/3688052934 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:51.321 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.312+0000 7fbee519d700 1 --2- 172.21.15.139:0/3688052934 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbee00a36e0 0x7fbee009f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:51.321 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.312+0000 7fbee599e700 1 --2- 172.21.15.139:0/3688052934 >> v2:172.21.15.72:3300/0 conn(0x7fbee00a7080 0x7fbee00a3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:51.321 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.312+0000 7fbee619f700 1 -- 172.21.15.139:0/3688052934 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbee00a36e0 msgr2=0x7fbee009f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:51.322 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.312+0000 7fbee619f700 1 --2- 172.21.15.139:0/3688052934 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbee00a36e0 0x7fbee009f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:51.322 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.312+0000 7fbee619f700 1 -- 172.21.15.139:0/3688052934 >> v2:172.21.15.72:3300/0 conn(0x7fbee00a7080 msgr2=0x7fbee00a3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:51.322 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.312+0000 7fbee619f700 1 --2- 172.21.15.139:0/3688052934 >> v2:172.21.15.72:3300/0 conn(0x7fbee00a7080 0x7fbee00a3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:51.322 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.312+0000 7fbee619f700 1 -- 172.21.15.139:0/3688052934 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee009ed20 con 0x7fbee009f680 2020-02-12T14:12:51.322 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.312+0000 7fbee519d700 1 --2- 172.21.15.139:0/3688052934 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbee00a36e0 0x7fbee009f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-12T14:12:51.322 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.312+0000 7fbee619f700 1 --2- 172.21.15.139:0/3688052934 >> v2:172.21.15.139:3300/0 conn(0x7fbee009f680 0x7fbee009faf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbed80032b0 tx=0x7fbed8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.322 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.312+0000 7fbee619f700 1 --2- 172.21.15.139:0/3688052934 >> v2:172.21.15.139:3300/0 conn(0x7fbee009f680 0x7fbee009faf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbed80032b0 tx=0x7fbed8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.323 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.312+0000 7fbee619f700 1 --2- 172.21.15.139:0/3688052934 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbee009f680 0x7fbee009faf0 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7fbed80032b0 tx=0x7fbed8007dc0).ready entity=mon.1 client_cookie=91236b40142120eb server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:51.323 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.312+0000 7fbee619f700 1 --2- 172.21.15.139:0/3688052934 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbee009f680 0x7fbee009faf0 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7fbed80032b0 tx=0x7fbed8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.323 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.312+0000 7fbee499c700 1 -- 172.21.15.139:0/3688052934 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbed800a160 con 0x7fbee009f680 2020-02-12T14:12:51.323 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.312+0000 7fbee619f700 1 --2- 172.21.15.139:0/3688052934 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbee009f680 0x7fbee009faf0 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7fbed80032b0 tx=0x7fbed8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.323 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.312+0000 7fbee619f700 1 --2- 172.21.15.139:0/3688052934 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbee009f680 0x7fbee009faf0 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7fbed80032b0 tx=0x7fbed8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.323 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.312+0000 7fbee499c700 1 -- 172.21.15.139:0/3688052934 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed800a2c0 con 0x7fbee009f680 2020-02-12T14:12:51.324 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.312+0000 7fbee499c700 1 -- 172.21.15.139:0/3688052934 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbed800a6a0 con 0x7fbee009f680 2020-02-12T14:12:51.324 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.312+0000 7fbee69a0700 1 -- 172.21.15.139:0/3688052934 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbee009f680 msgr2=0x7fbee009faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:51.324 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.312+0000 7fbee69a0700 1 --2- 172.21.15.139:0/3688052934 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbee009f680 0x7fbee009faf0 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7fbed80032b0 tx=0x7fbed8007dc0).stop 2020-02-12T14:12:51.324 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.313+0000 7fbee69a0700 1 -- 172.21.15.139:0/3688052934 shutdown_connections 2020-02-12T14:12:51.324 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.313+0000 7fbee69a0700 1 --2- 172.21.15.139:0/3688052934 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbee009f680 0x7fbee009faf0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:51.324 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.313+0000 7fbee69a0700 1 --2- 172.21.15.139:0/3688052934 >> v2:172.21.15.72:3300/0 conn(0x7fbee00a7080 0x7fbee00a3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:51.325 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.313+0000 7fbee69a0700 1 --2- 172.21.15.139:0/3688052934 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbee00a36e0 0x7fbee009f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:51.325 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.313+0000 7fbee69a0700 1 -- 172.21.15.139:0/3688052934 >> 172.21.15.139:0/3688052934 conn(0x7fbee005a720 msgr2=0x7fbee005ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:51.325 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.313+0000 7fbee69a0700 1 -- 172.21.15.139:0/3688052934 shutdown_connections 2020-02-12T14:12:51.325 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.313+0000 7fbee69a0700 1 -- 172.21.15.139:0/3688052934 wait complete. 2020-02-12T14:12:51.325 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.313+0000 7fbee69a0700 1 Processor -- start 2020-02-12T14:12:51.325 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.313+0000 7fbee69a0700 1 -- start start 2020-02-12T14:12:51.326 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.314+0000 7fbee69a0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbee00a36e0 0x7fbee00639b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:51.326 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.314+0000 7fbee69a0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee0066860 con 0x7fbee00a7080 2020-02-12T14:12:51.326 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.314+0000 7fbee69a0700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee00665c0 con 0x7fbee009f680 2020-02-12T14:12:51.326 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.314+0000 7fbee69a0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee00652d0 con 0x7fbee00a36e0 2020-02-12T14:12:51.326 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.314+0000 7fbee599e700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fbee009f680 0x7fbee0136f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35834/0 (socket says 172.21.15.139:35834) 2020-02-12T14:12:51.326 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.314+0000 7fbee599e700 1 -- 172.21.15.139:0/859302160 learned_addr learned my addr 172.21.15.139:0/859302160 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:51.326 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.314+0000 7fbeceffd700 1 -- 172.21.15.139:0/859302160 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 108734711 0 0) 0x7fbee00665c0 con 0x7fbee009f680 2020-02-12T14:12:51.327 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.314+0000 7fbeceffd700 1 -- 172.21.15.139:0/859302160 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbec0002fe0 con 0x7fbee009f680 2020-02-12T14:12:51.327 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.314+0000 7fbee519d700 1 --2- 172.21.15.139:0/859302160 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbee00a36e0 0x7fbee00639b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:51.327 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbeceffd700 1 -- 172.21.15.139:0/859302160 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1627280953 0 0) 0x7fbec0002fe0 con 0x7fbee009f680 2020-02-12T14:12:51.327 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbeceffd700 1 -- 172.21.15.139:0/859302160 --> v1:172.21.15.139:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbee00665c0 con 0x7fbee009f680 2020-02-12T14:12:51.327 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbeceffd700 1 -- 172.21.15.139:0/859302160 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7fbedc002710 con 0x7fbee009f680 2020-02-12T14:12:51.327 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbeceffd700 1 -- 172.21.15.139:0/859302160 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbee00a36e0 msgr2=0x7fbee00639b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:51.327 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbeceffd700 1 --2- 172.21.15.139:0/859302160 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbee00a36e0 0x7fbee00639b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:51.328 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbeceffd700 1 -- 172.21.15.139:0/859302160 >> v1:172.21.15.139:6789/0 conn(0x7fbee009f680 legacy=0x7fbee0136f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:51.328 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbeceffd700 1 -- 172.21.15.139:0/859302160 >> v1:172.21.15.72:6789/0 conn(0x7fbee00a7080 legacy=0x7fbee014df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:51.328 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbeceffd700 1 --2- 172.21.15.139:0/859302160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbec00049b0 0x7fbec0004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:51.328 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbeceffd700 1 --2- 172.21.15.139:0/859302160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbec0003920 0x7fbec0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:51.328 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbeceffd700 1 --2- 172.21.15.139:0/859302160 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbee00a36e0 0x7fbec0004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:51.328 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbeceffd700 1 -- 172.21.15.139:0/859302160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee00652d0 con 0x7fbec00049b0 2020-02-12T14:12:51.329 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbeceffd700 1 -- 172.21.15.139:0/859302160 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec0005450 con 0x7fbec0003920 2020-02-12T14:12:51.329 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbeceffd700 1 -- 172.21.15.139:0/859302160 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec0004660 con 0x7fbee00a36e0 2020-02-12T14:12:51.329 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbee519d700 1 --2- 172.21.15.139:0/859302160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbec0003920 0x7fbec0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:51.329 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbee599e700 1 --2- 172.21.15.139:0/859302160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbec00049b0 0x7fbec0004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:51.329 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbee619f700 1 --2- 172.21.15.139:0/859302160 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbee00a36e0 0x7fbec0004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:51.329 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbee519d700 1 -- 172.21.15.139:0/859302160 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbee00a36e0 msgr2=0x7fbec0004200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:51.329 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbee519d700 1 --2- 172.21.15.139:0/859302160 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbee00a36e0 0x7fbec0004200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:51.330 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbee519d700 1 -- 172.21.15.139:0/859302160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbec00049b0 msgr2=0x7fbec0004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:51.330 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbee519d700 1 --2- 172.21.15.139:0/859302160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbec00049b0 0x7fbec0004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:51.330 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbee519d700 1 -- 172.21.15.139:0/859302160 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee0063510 con 0x7fbec0003920 2020-02-12T14:12:51.330 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbee69a0700 1 -- 172.21.15.139:0/859302160 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee00a91c0 con 0x7fbec0003920 2020-02-12T14:12:51.330 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbee519d700 1 --2- 172.21.15.139:0/859302160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbec0003920 0x7fbec0003da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbed0002f30 tx=0x7fbed0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.330 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbee69a0700 1 -- 172.21.15.139:0/859302160 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee0137620 con 0x7fbec0003920 2020-02-12T14:12:51.330 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbee519d700 1 --2- 172.21.15.139:0/859302160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbec0003920 0x7fbec0003da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbed0002f30 tx=0x7fbed0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.330 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbee519d700 1 --2- 172.21.15.139:0/859302160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbec0003920 0x7fbec0003da0 secure :-1 s=READY pgs=203 cs=0 l=1 rx=0x7fbed0002f30 tx=0x7fbed0010ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:51.331 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbee519d700 1 --2- 172.21.15.139:0/859302160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbec0003920 0x7fbec0003da0 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fbed0002f30 tx=0x7fbed0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.331 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbee519d700 1 --2- 172.21.15.139:0/859302160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbec0003920 0x7fbec0003da0 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fbed0002f30 tx=0x7fbed0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.331 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbeceffd700 1 -- 172.21.15.139:0/859302160 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbed0007150 con 0x7fbec0003920 2020-02-12T14:12:51.331 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbee519d700 1 --2- 172.21.15.139:0/859302160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbec0003920 0x7fbec0003da0 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fbed0002f30 tx=0x7fbed0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.331 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbeceffd700 1 -- 172.21.15.139:0/859302160 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed00072b0 con 0x7fbec0003920 2020-02-12T14:12:51.332 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.315+0000 7fbeceffd700 1 -- 172.21.15.139:0/859302160 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbed00118e0 con 0x7fbec0003920 2020-02-12T14:12:51.332 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.316+0000 7fbee519d700 1 --2- 172.21.15.139:0/859302160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbec0003920 0x7fbec0003da0 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fbed0002f30 tx=0x7fbed0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.332 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.316+0000 7fbeceffd700 1 -- 172.21.15.139:0/859302160 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fbed0011a40 con 0x7fbec0003920 2020-02-12T14:12:51.332 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.316+0000 7fbee519d700 1 --2- 172.21.15.139:0/859302160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbec0003920 0x7fbec0003da0 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fbed0002f30 tx=0x7fbed0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.332 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.316+0000 7fbeceffd700 1 --2- 172.21.15.139:0/859302160 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fbec0041fe0 0x7fbec00444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:51.332 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.316+0000 7fbee69a0700 1 -- 172.21.15.139:0/859302160 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee00636a0 con 0x7fbec0003920 2020-02-12T14:12:51.332 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.316+0000 7fbeceffd700 1 -- 172.21.15.139:0/859302160 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fbed00495c0 con 0x7fbec0003920 2020-02-12T14:12:51.332 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.316+0000 7fbee599e700 1 --2- 172.21.15.139:0/859302160 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fbec0041fe0 0x7fbec00444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:51.333 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.316+0000 7fbee599e700 1 --2- 172.21.15.139:0/859302160 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fbec0041fe0 0x7fbec00444a0 crc :-1 s=READY pgs=85 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:51.333 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.320+0000 7fbee519d700 1 --2- 172.21.15.139:0/859302160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbec0003920 0x7fbec0003da0 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fbed0002f30 tx=0x7fbed0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.333 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.320+0000 7fbeceffd700 1 -- 172.21.15.139:0/859302160 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fbed002ecb0 con 0x7fbec0003920 2020-02-12T14:12:51.455 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.454+0000 7fbee69a0700 1 -- 172.21.15.139:0/859302160 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbee0067e20 con 0x7fbec0003920 2020-02-12T14:12:51.456 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.455+0000 7fbee519d700 1 --2- 172.21.15.139:0/859302160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbec0003920 0x7fbec0003da0 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fbed0002f30 tx=0x7fbed0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.456 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.455+0000 7fbeceffd700 1 -- 172.21.15.139:0/859302160 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14933 (secure 0 0 0) 0x7fbed00317c0 con 0x7fbec0003920 2020-02-12T14:12:51.456 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:12:51.457 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":23,"fsid":"dacc9a6c-9e88-46ac-940b-c4a329dbffec","created":"2020-02-12T14:12:18.258232+0000","modified":"2020-02-12T14:12:39.447885+0000","last_up_change":"2020-02-12T14:12:27.050924+0000","last_in_change":"2020-02-12T14:12:27.050924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-12T14:12:31.091380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-02-12T14:12:34.160095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-02-12T14:12:37.119732+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffc0664d-9b93-45a4-a454-7655ee26d582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":22147},{"type":"v1","addr":"172.21.15.139:6803","nonce":22147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":22147},{"type":"v1","addr":"172.21.15.139:6805","nonce":22147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":22147},{"type":"v1","addr":"172.21.15.139:6809","nonce":22147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":22147},{"type":"v1","addr":"172.21.15.139:6807","nonce":22147}]},"public_addr":"172.21.15.139:6803/22147","cluster_addr":"172.21.15.139:6805/22147","heartbeat_back_addr":"172.21.15.139:6809/22147","heartbeat_front_addr":"172.21.15.139:6807/22147","state":["exists","up"]},{"osd":1,"uuid":"f66da6bc-43b3-4846-85f9-a25e3fe95216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":22148},{"type":"v1","addr":"172.21.15.139:6811","nonce":22148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":22148},{"type":"v1","addr":"172.21.15.139:6813","nonce":22148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6819","nonce":22148},{"type":"v1","addr":"172.21.15.139:6821","nonce":22148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6815","nonce":22148},{"type":"v1","addr":"172.21.15.139:6817","nonce":22148}]},"public_addr":"172.21.15.139:6811/22148","cluster_addr":"172.21.15.139:6813/22148","heartbeat_back_addr":"172.21.15.139:6821/22148","heartbeat_front_addr":"172.21.15.139:6817/22148","state":["exists","up"]},{"osd":2,"uuid":"c35fb293-3e16-41e8-85f3-768e11e55b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":22149},{"type":"v1","addr":"172.21.15.139:6827","nonce":22149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":22149},{"type":"v1","addr":"172.21.15.139:6829","nonce":22149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":22149},{"type":"v1","addr":"172.21.15.139:6833","nonce":22149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":22149},{"type":"v1","addr":"172.21.15.139:6831","nonce":22149}]},"public_addr":"172.21.15.139:6827/22149","cluster_addr":"172.21.15.139:6829/22149","heartbeat_back_addr":"172.21.15.139:6833/22149","heartbeat_front_addr":"172.21.15.139:6831/22149","state":["exists","up"]},{"osd":3,"uuid":"bc8b2c0d-e3dd-48cb-883e-6ea965aee923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":22150},{"type":"v1","addr":"172.21.15.139:6816","nonce":22150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":22150},{"type":"v1","addr":"172.21.15.139:6820","nonce":22150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":22150},{"type":"v1","addr":"172.21.15.139:6825","nonce":22150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":22150},{"type":"v1","addr":"172.21.15.139:6823","nonce":22150}]},"public_addr":"172.21.15.139:6816/22150","cluster_addr":"172.21.15.139:6820/22150","heartbeat_back_addr":"172.21.15.139:6825/22150","heartbeat_front_addr":"172.21.15.139:6823/22150","state":["exists","up"]},{"osd":4,"uuid":"aadfc406-0c40-4b6b-9e19-c92b2f40264a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":21598},{"type":"v1","addr":"172.21.15.72:6801","nonce":21598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":21598},{"type":"v1","addr":"172.21.15.72:6803","nonce":21598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":21598},{"type":"v1","addr":"172.21.15.72:6807","nonce":21598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":21598},{"type":"v1","addr":"172.21.15.72:6805","nonce":21598}]},"public_addr":"172.21.15.72:6801/21598","cluster_addr":"172.21.15.72:6803/21598","heartbeat_back_addr":"172.21.15.72:6807/21598","heartbeat_front_addr":"172.21.15.72:6805/21598","state":["exists","up"]},{"osd":5,"uuid":"3296dc8e-9322-4430-abd2-7672da5b7acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":21599},{"type":"v1","addr":"172.21.15.72:6810","nonce":21599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":21599},{"type":"v1","addr":"172.21.15.72:6815","nonce":21599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":21599},{"type":"v1","addr":"172.21.15.72:6823","nonce":21599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":21599},{"type":"v1","addr":"172.21.15.72:6820","nonce":21599}]},"public_addr":"172.21.15.72:6810/21599","cluster_addr":"172.21.15.72:6815/21599","heartbeat_back_addr":"172.21.15.72:6823/21599","heartbeat_front_addr":"172.21.15.72:6820/21599","state":["exists","up"]},{"osd":6,"uuid":"7c39cf20-a3a8-4d56-8577-f4102b302a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":21601},{"type":"v1","addr":"172.21.15.72:6811","nonce":21601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":21601},{"type":"v1","addr":"172.21.15.72:6814","nonce":21601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":21601},{"type":"v1","addr":"172.21.15.72:6821","nonce":21601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":21601},{"type":"v1","addr":"172.21.15.72:6818","nonce":21601}]},"public_addr":"172.21.15.72:6811/21601","cluster_addr":"172.21.15.72:6814/21601","heartbeat_back_addr":"172.21.15.72:6821/21601","heartbeat_front_addr":"172.21.15.72:6818/21601","state":["exists","up"]},{"osd":7,"uuid":"f452adff-8432-47e9-a5f1-9fd7e2a04a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":21600},{"type":"v1","addr":"172.21.15.72:6825","nonce":21600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":21600},{"type":"v1","addr":"172.21.15.72:6827","nonce":21600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":21600},{"type":"v1","addr":"172.21.15.72:6831","nonce":21600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":21600},{"type":"v1","addr":"172.21.15.72:6829","nonce":21600}]},"public_addr":"172.21.15.72:6825/21600","cluster_addr":"172.21.15.72:6827/21600","heartbeat_back_addr":"172.21.15.72:6831/21600","heartbeat_front_addr":"172.21.15.72:6829/21600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.259782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.267019+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.315501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.326256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.335328+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.284130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.083179+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T14:12:25.351445+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-12T14:12:51.458 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.456+0000 7fbee69a0700 1 -- 172.21.15.139:0/859302160 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fbec0041fe0 msgr2=0x7fbec00444a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:51.458 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.456+0000 7fbee69a0700 1 --2- 172.21.15.139:0/859302160 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fbec0041fe0 0x7fbec00444a0 crc :-1 s=READY pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:51.458 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.456+0000 7fbee69a0700 1 -- 172.21.15.139:0/859302160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbec0003920 msgr2=0x7fbec0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:51.458 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.456+0000 7fbee69a0700 1 --2- 172.21.15.139:0/859302160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbec0003920 0x7fbec0003da0 secure :-1 s=READY pgs=203 cs=0 l=1 rx=0x7fbed0002f30 tx=0x7fbed0010ec0).stop 2020-02-12T14:12:51.459 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.456+0000 7fbee619f700 1 -- 172.21.15.139:0/859302160 reap_dead start 2020-02-12T14:12:51.459 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.456+0000 7fbee69a0700 1 -- 172.21.15.139:0/859302160 shutdown_connections 2020-02-12T14:12:51.459 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.456+0000 7fbee69a0700 1 -- 172.21.15.139:0/859302160 >> 172.21.15.139:0/859302160 conn(0x7fbee005a720 msgr2=0x7fbee00a0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:51.459 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.456+0000 7fbee69a0700 1 -- 172.21.15.139:0/859302160 shutdown_connections 2020-02-12T14:12:51.459 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.456+0000 7fbee69a0700 1 -- 172.21.15.139:0/859302160 wait complete. 2020-02-12T14:12:51.469 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-12T14:12:31.091380+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-12T14:12:34.160095+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-12T14:12:37.119732+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-02-12T14:12:51.469 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-02-12T14:12:51.578 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.577+0000 7fe9ee57b700 1 Processor -- start 2020-02-12T14:12:51.579 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.577+0000 7fe9ee57b700 1 -- start start 2020-02-12T14:12:51.581 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.578+0000 7fe9ee57b700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe9e80a3f40 0x7fe9e8134df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:51.582 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.578+0000 7fe9ee57b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9e80a24a0 0x7fe9e812e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:51.582 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.578+0000 7fe9ee57b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e81359e0 con 0x7fe9e8135250 2020-02-12T14:12:51.582 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.578+0000 7fe9ee57b700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e8135c80 con 0x7fe9e80a3f40 2020-02-12T14:12:51.582 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.578+0000 7fe9ee57b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e80a18f0 con 0x7fe9e80a24a0 2020-02-12T14:12:51.582 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.578+0000 7fe9e7fff700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe9e80a3f40 0x7fe9e8134df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:51.582 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.578+0000 7fe9e7fff700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe9e80a3f40 0x7fe9e8134df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47210/0 (socket says 172.21.15.139:47210) 2020-02-12T14:12:51.583 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.578+0000 7fe9e7fff700 1 -- 172.21.15.139:0/3596801398 learned_addr learned my addr 172.21.15.139:0/3596801398 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:51.583 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.578+0000 7fe9ecb18700 1 --2- 172.21.15.139:0/3596801398 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9e80a24a0 0x7fe9e812e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:51.583 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.578+0000 7fe9e7fff700 1 -- 172.21.15.139:0/3596801398 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9e80a24a0 msgr2=0x7fe9e812e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:51.583 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.578+0000 7fe9e7fff700 1 --2- 172.21.15.139:0/3596801398 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9e80a24a0 0x7fe9e812e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:51.583 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.578+0000 7fe9e7fff700 1 -- 172.21.15.139:0/3596801398 >> v1:172.21.15.72:6789/0 conn(0x7fe9e8135250 legacy=0x7fe9e80a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:51.583 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.578+0000 7fe9e7fff700 1 -- 172.21.15.139:0/3596801398 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e81356e0 con 0x7fe9e80a3f40 2020-02-12T14:12:51.583 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.578+0000 7fe9e7fff700 1 --2- 172.21.15.139:0/3596801398 >> v2:172.21.15.139:3300/0 conn(0x7fe9e80a3f40 0x7fe9e8134df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe9e8060f00 tx=0x7fe9d80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.578+0000 7fe9e7fff700 1 --2- 172.21.15.139:0/3596801398 >> v2:172.21.15.139:3300/0 conn(0x7fe9e80a3f40 0x7fe9e8134df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe9e8060f00 tx=0x7fe9d80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.578+0000 7fe9e7fff700 1 --2- 172.21.15.139:0/3596801398 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e80a3f40 0x7fe9e8134df0 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7fe9e8060f00 tx=0x7fe9d80088e0).ready entity=mon.1 client_cookie=5eec9f2685dbf56 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:51.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.578+0000 7fe9e7fff700 1 --2- 172.21.15.139:0/3596801398 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e80a3f40 0x7fe9e8134df0 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7fe9e8060f00 tx=0x7fe9d80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.579+0000 7fe9e7fff700 1 --2- 172.21.15.139:0/3596801398 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e80a3f40 0x7fe9e8134df0 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7fe9e8060f00 tx=0x7fe9d80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.579+0000 7fe9e6ffd700 1 -- 172.21.15.139:0/3596801398 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9d8011720 con 0x7fe9e80a3f40 2020-02-12T14:12:51.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.579+0000 7fe9e7fff700 1 --2- 172.21.15.139:0/3596801398 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e80a3f40 0x7fe9e8134df0 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7fe9e8060f00 tx=0x7fe9d80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.584 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.579+0000 7fe9e6ffd700 1 -- 172.21.15.139:0/3596801398 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d8011880 con 0x7fe9e80a3f40 2020-02-12T14:12:51.585 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.579+0000 7fe9e6ffd700 1 -- 172.21.15.139:0/3596801398 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9d8011c20 con 0x7fe9e80a3f40 2020-02-12T14:12:51.585 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.579+0000 7fe9ee57b700 1 -- 172.21.15.139:0/3596801398 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e80a3f40 msgr2=0x7fe9e8134df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:51.585 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.579+0000 7fe9ee57b700 1 --2- 172.21.15.139:0/3596801398 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e80a3f40 0x7fe9e8134df0 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7fe9e8060f00 tx=0x7fe9d80088e0).stop 2020-02-12T14:12:51.585 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.579+0000 7fe9ee57b700 1 -- 172.21.15.139:0/3596801398 shutdown_connections 2020-02-12T14:12:51.585 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.579+0000 7fe9ee57b700 1 --2- 172.21.15.139:0/3596801398 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9e80a24a0 0x7fe9e812e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:51.585 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.579+0000 7fe9ee57b700 1 --2- 172.21.15.139:0/3596801398 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e80a3f40 0x7fe9e8134df0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:51.585 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.579+0000 7fe9ee57b700 1 -- 172.21.15.139:0/3596801398 >> 172.21.15.139:0/3596801398 conn(0x7fe9e8060950 msgr2=0x7fe9e809d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:51.586 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.579+0000 7fe9ee57b700 1 -- 172.21.15.139:0/3596801398 shutdown_connections 2020-02-12T14:12:51.586 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.579+0000 7fe9ee57b700 1 -- 172.21.15.139:0/3596801398 wait complete. 2020-02-12T14:12:51.586 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.580+0000 7fe9ee57b700 1 Processor -- start 2020-02-12T14:12:51.586 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.580+0000 7fe9ee57b700 1 -- start start 2020-02-12T14:12:51.589 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.581+0000 7fe9ee57b700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe9e80a3f40 0x7fe9e80a0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:51.589 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.581+0000 7fe9ee57b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe9e8135250 0x7fe9e8061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:51.589 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.581+0000 7fe9ee57b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e80a1260 con 0x7fe9e80a24a0 2020-02-12T14:12:51.589 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.581+0000 7fe9ee57b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e8061ac0 con 0x7fe9e8135250 2020-02-12T14:12:51.589 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.581+0000 7fe9ee57b700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e8131250 con 0x7fe9e80a3f40 2020-02-12T14:12:51.589 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.581+0000 7fe9e77fe700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe9e80a3f40 0x7fe9e80a0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:51.590 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.581+0000 7fe9e77fe700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe9e80a3f40 0x7fe9e80a0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47218/0 (socket says 172.21.15.139:47218) 2020-02-12T14:12:51.590 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.581+0000 7fe9e77fe700 1 -- 172.21.15.139:0/2580457595 learned_addr learned my addr 172.21.15.139:0/2580457595 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:51.590 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.581+0000 7fe9ecb18700 1 --2- 172.21.15.139:0/2580457595 >> v2:172.21.15.72:3300/0 conn(0x7fe9e8135250 0x7fe9e8061660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:51.590 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.581+0000 7fe9e77fe700 1 -- 172.21.15.139:0/2580457595 >> v2:172.21.15.72:3300/0 conn(0x7fe9e8135250 msgr2=0x7fe9e8061660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:51.590 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.581+0000 7fe9e77fe700 1 --2- 172.21.15.139:0/2580457595 >> v2:172.21.15.72:3300/0 conn(0x7fe9e8135250 0x7fe9e8061660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:51.590 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.581+0000 7fe9e77fe700 1 -- 172.21.15.139:0/2580457595 >> v1:172.21.15.72:6789/0 conn(0x7fe9e80a24a0 legacy=0x7fe9e8131c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:51.590 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.581+0000 7fe9e77fe700 1 -- 172.21.15.139:0/2580457595 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e81314f0 con 0x7fe9e80a3f40 2020-02-12T14:12:51.591 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.581+0000 7fe9e77fe700 1 --2- 172.21.15.139:0/2580457595 >> v2:172.21.15.139:3300/0 conn(0x7fe9e80a3f40 0x7fe9e80a0160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe9dc001f50 tx=0x7fe9dc00c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.591 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.581+0000 7fe9e77fe700 1 --2- 172.21.15.139:0/2580457595 >> v2:172.21.15.139:3300/0 conn(0x7fe9e80a3f40 0x7fe9e80a0160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe9dc001f50 tx=0x7fe9dc00c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.591 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.581+0000 7fe9e77fe700 1 --2- 172.21.15.139:0/2580457595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e80a3f40 0x7fe9e80a0160 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x7fe9dc001f50 tx=0x7fe9dc00c460).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:51.591 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.581+0000 7fe9e77fe700 1 --2- 172.21.15.139:0/2580457595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e80a3f40 0x7fe9e80a0160 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7fe9dc001f50 tx=0x7fe9dc00c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.591 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.581+0000 7fe9e57fa700 1 -- 172.21.15.139:0/2580457595 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9dc00cc20 con 0x7fe9e80a3f40 2020-02-12T14:12:51.591 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.581+0000 7fe9e77fe700 1 --2- 172.21.15.139:0/2580457595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e80a3f40 0x7fe9e80a0160 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7fe9dc001f50 tx=0x7fe9dc00c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.591 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.581+0000 7fe9e77fe700 1 --2- 172.21.15.139:0/2580457595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e80a3f40 0x7fe9e80a0160 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7fe9dc001f50 tx=0x7fe9dc00c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.591 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.581+0000 7fe9e57fa700 1 -- 172.21.15.139:0/2580457595 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9dc00cd80 con 0x7fe9e80a3f40 2020-02-12T14:12:51.592 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.581+0000 7fe9ee57b700 1 -- 172.21.15.139:0/2580457595 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e8132340 con 0x7fe9e80a3f40 2020-02-12T14:12:51.592 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.581+0000 7fe9e57fa700 1 -- 172.21.15.139:0/2580457595 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9dc00e350 con 0x7fe9e80a3f40 2020-02-12T14:12:51.592 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.581+0000 7fe9ee57b700 1 -- 172.21.15.139:0/2580457595 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e809eb80 con 0x7fe9e80a3f40 2020-02-12T14:12:51.592 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.582+0000 7fe9e77fe700 1 --2- 172.21.15.139:0/2580457595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e80a3f40 0x7fe9e80a0160 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7fe9dc001f50 tx=0x7fe9dc00c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.592 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.582+0000 7fe9e57fa700 1 -- 172.21.15.139:0/2580457595 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fe9dc0064e0 con 0x7fe9e80a3f40 2020-02-12T14:12:51.592 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.582+0000 7fe9e77fe700 1 --2- 172.21.15.139:0/2580457595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e80a3f40 0x7fe9e80a0160 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7fe9dc001f50 tx=0x7fe9dc00c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.592 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.582+0000 7fe9ee57b700 1 -- 172.21.15.139:0/2580457595 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e8067e20 con 0x7fe9e80a3f40 2020-02-12T14:12:51.593 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.582+0000 7fe9e57fa700 1 --2- 172.21.15.139:0/2580457595 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fe9c8039ca0 0x7fe9c803c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:51.593 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.582+0000 7fe9e57fa700 1 -- 172.21.15.139:0/2580457595 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fe9dc049720 con 0x7fe9e80a3f40 2020-02-12T14:12:51.593 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.582+0000 7fe9e7fff700 1 --2- 172.21.15.139:0/2580457595 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fe9c8039ca0 0x7fe9c803c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:51.593 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.583+0000 7fe9e7fff700 1 --2- 172.21.15.139:0/2580457595 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fe9c8039ca0 0x7fe9c803c160 crc :-1 s=READY pgs=86 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:51.593 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.586+0000 7fe9e77fe700 1 --2- 172.21.15.139:0/2580457595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e80a3f40 0x7fe9e80a0160 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7fe9dc001f50 tx=0x7fe9dc00c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.593 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.586+0000 7fe9e57fa700 1 -- 172.21.15.139:0/2580457595 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fe9dc02ed50 con 0x7fe9e80a3f40 2020-02-12T14:12:51.721 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.720+0000 7fe9ee57b700 1 -- 172.21.15.139:0/2580457595 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe9e8059fd0 con 0x7fe9e80a3f40 2020-02-12T14:12:51.722 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.721+0000 7fe9e77fe700 1 --2- 172.21.15.139:0/2580457595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e80a3f40 0x7fe9e80a0160 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7fe9dc001f50 tx=0x7fe9dc00c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.722 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.721+0000 7fe9e57fa700 1 -- 172.21.15.139:0/2580457595 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe9dc031860 con 0x7fe9e80a3f40 2020-02-12T14:12:51.722 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 8 2020-02-12T14:12:51.724 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.722+0000 7fe9ee57b700 1 -- 172.21.15.139:0/2580457595 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fe9c8039ca0 msgr2=0x7fe9c803c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:51.724 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.722+0000 7fe9ee57b700 1 --2- 172.21.15.139:0/2580457595 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fe9c8039ca0 0x7fe9c803c160 crc :-1 s=READY pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:51.724 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.722+0000 7fe9ee57b700 1 -- 172.21.15.139:0/2580457595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e80a3f40 msgr2=0x7fe9e80a0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:51.724 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.722+0000 7fe9ee57b700 1 --2- 172.21.15.139:0/2580457595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e80a3f40 0x7fe9e80a0160 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x7fe9dc001f50 tx=0x7fe9dc00c460).stop 2020-02-12T14:12:51.724 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.722+0000 7fe9ee57b700 1 -- 172.21.15.139:0/2580457595 shutdown_connections 2020-02-12T14:12:51.724 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.722+0000 7fe9ee57b700 1 --2- 172.21.15.139:0/2580457595 >> v2:172.21.15.72:3300/0 conn(0x7fe9e8135250 0x7fe9e8061660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:51.725 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.722+0000 7fe9ee57b700 1 --2- 172.21.15.139:0/2580457595 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7fe9c8039ca0 0x7fe9c803c160 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:51.725 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.722+0000 7fe9ee57b700 1 --2- 172.21.15.139:0/2580457595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e80a3f40 0x7fe9e80a0160 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:51.725 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.722+0000 7fe9ee57b700 1 -- 172.21.15.139:0/2580457595 >> 172.21.15.139:0/2580457595 conn(0x7fe9e8060950 msgr2=0x7fe9e80aab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:51.725 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.722+0000 7fe9ee57b700 1 -- 172.21.15.139:0/2580457595 shutdown_connections 2020-02-12T14:12:51.725 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.722+0000 7fe9ee57b700 1 -- 172.21.15.139:0/2580457595 wait complete. 2020-02-12T14:12:51.733 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-02-12T14:12:51.841 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.840+0000 7f266a650700 1 Processor -- start 2020-02-12T14:12:51.841 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.840+0000 7f266a650700 1 -- start start 2020-02-12T14:12:51.847 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f266a650700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2664066a30 0x7f2664067050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:51.848 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f266a650700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f266413ba20 0x7f2664138530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:51.848 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f266a650700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2664138990 0x7f2664131d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:51.848 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f266a650700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2664065950 con 0x7f2664138990 2020-02-12T14:12:51.848 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f266a650700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f266413bea0 con 0x7f266413ba20 2020-02-12T14:12:51.848 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f266a650700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266413c100 con 0x7f2664066a30 2020-02-12T14:12:51.848 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f26637fe700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f266413ba20 0x7f2664138530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:51.849 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f26637fe700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f266413ba20 0x7f2664138530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47226/0 (socket says 172.21.15.139:47226) 2020-02-12T14:12:51.849 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f26637fe700 1 -- 172.21.15.139:0/2853156179 learned_addr learned my addr 172.21.15.139:0/2853156179 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:51.849 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f2663fff700 1 --2- 172.21.15.139:0/2853156179 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2664066a30 0x7f2664067050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:51.849 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f2668bed700 1 --2- 172.21.15.139:0/2853156179 >> v2:172.21.15.72:3300/0 conn(0x7f2664138990 0x7f2664131d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:51.849 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f26637fe700 1 -- 172.21.15.139:0/2853156179 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2664066a30 msgr2=0x7f2664067050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:51.849 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f26637fe700 1 --2- 172.21.15.139:0/2853156179 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2664066a30 0x7f2664067050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:51.850 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f26637fe700 1 -- 172.21.15.139:0/2853156179 >> v2:172.21.15.72:3300/0 conn(0x7f2664138990 msgr2=0x7f2664131d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:51.850 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f26637fe700 1 --2- 172.21.15.139:0/2853156179 >> v2:172.21.15.72:3300/0 conn(0x7f2664138990 0x7f2664131d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:51.850 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f26637fe700 1 -- 172.21.15.139:0/2853156179 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266413c3a0 con 0x7f266413ba20 2020-02-12T14:12:51.850 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f2668bed700 1 --2- 172.21.15.139:0/2853156179 >> v2:172.21.15.72:3300/0 conn(0x7f2664138990 0x7f2664131d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T14:12:51.850 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f26637fe700 1 --2- 172.21.15.139:0/2853156179 >> v2:172.21.15.139:3300/0 conn(0x7f266413ba20 0x7f2664138530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2658002f30 tx=0x7f2658007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.851 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f26637fe700 1 --2- 172.21.15.139:0/2853156179 >> v2:172.21.15.139:3300/0 conn(0x7f266413ba20 0x7f2664138530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2658002f30 tx=0x7f2658007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.851 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f26637fe700 1 --2- 172.21.15.139:0/2853156179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f266413ba20 0x7f2664138530 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7f2658002f30 tx=0x7f2658007a40).ready entity=mon.1 client_cookie=8e11744cff916287 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:51.851 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f26637fe700 1 --2- 172.21.15.139:0/2853156179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f266413ba20 0x7f2664138530 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f2658002f30 tx=0x7f2658007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.851 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f26637fe700 1 --2- 172.21.15.139:0/2853156179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f266413ba20 0x7f2664138530 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f2658002f30 tx=0x7f2658007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.851 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f2662ffd700 1 -- 172.21.15.139:0/2853156179 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2658011670 con 0x7f266413ba20 2020-02-12T14:12:51.851 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f26637fe700 1 --2- 172.21.15.139:0/2853156179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f266413ba20 0x7f2664138530 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f2658002f30 tx=0x7f2658007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.851 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f2662ffd700 1 -- 172.21.15.139:0/2853156179 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26580117d0 con 0x7f266413ba20 2020-02-12T14:12:51.852 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f2662ffd700 1 -- 172.21.15.139:0/2853156179 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2658011b70 con 0x7f266413ba20 2020-02-12T14:12:51.852 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f266a650700 1 -- 172.21.15.139:0/2853156179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f266413ba20 msgr2=0x7f2664138530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:51.852 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.841+0000 7f266a650700 1 --2- 172.21.15.139:0/2853156179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f266413ba20 0x7f2664138530 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7f2658002f30 tx=0x7f2658007a40).stop 2020-02-12T14:12:51.852 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.842+0000 7f266a650700 1 -- 172.21.15.139:0/2853156179 shutdown_connections 2020-02-12T14:12:51.852 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.842+0000 7f266a650700 1 --2- 172.21.15.139:0/2853156179 >> v2:172.21.15.72:3300/0 conn(0x7f2664138990 0x7f2664131d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:51.852 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.842+0000 7f266a650700 1 --2- 172.21.15.139:0/2853156179 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2664066a30 0x7f2664067050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:51.853 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.842+0000 7f266a650700 1 --2- 172.21.15.139:0/2853156179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f266413ba20 0x7f2664138530 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:51.853 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.842+0000 7f266a650700 1 -- 172.21.15.139:0/2853156179 >> 172.21.15.139:0/2853156179 conn(0x7f2664060950 msgr2=0x7f266409d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:51.853 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.842+0000 7f266a650700 1 -- 172.21.15.139:0/2853156179 shutdown_connections 2020-02-12T14:12:51.853 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.842+0000 7f266a650700 1 -- 172.21.15.139:0/2853156179 wait complete. 2020-02-12T14:12:51.853 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.843+0000 7f266a650700 1 Processor -- start 2020-02-12T14:12:51.853 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.843+0000 7f266a650700 1 -- start start 2020-02-12T14:12:51.853 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.843+0000 7f266a650700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2664138990 0x7f26640a3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:51.854 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.843+0000 7f266a650700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f266413ba20 0x7f266413b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:51.854 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.843+0000 7f266a650700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26640a4520 con 0x7f2664066a30 2020-02-12T14:12:51.854 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.843+0000 7f266a650700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26641452f0 con 0x7f2664138990 2020-02-12T14:12:51.854 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.843+0000 7f266a650700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2664148a40 con 0x7f266413ba20 2020-02-12T14:12:51.854 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.844+0000 7f2663fff700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f2664066a30 0x7f2664148ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35868/0 (socket says 172.21.15.139:35868) 2020-02-12T14:12:51.854 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.844+0000 7f2663fff700 1 -- 172.21.15.139:0/3520217325 learned_addr learned my addr 172.21.15.139:0/3520217325 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:51.855 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.844+0000 7f2668bed700 1 --2- 172.21.15.139:0/3520217325 >> v2:172.21.15.139:3300/0 conn(0x7f266413ba20 0x7f266413b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:51.855 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.844+0000 7f26637fe700 1 --2- 172.21.15.139:0/3520217325 >> v2:172.21.15.72:3300/0 conn(0x7f2664138990 0x7f26640a3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:51.855 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.844+0000 7f2668bed700 1 -- 172.21.15.139:0/3520217325 >> v2:172.21.15.72:3300/0 conn(0x7f2664138990 msgr2=0x7f26640a3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:51.855 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.844+0000 7f2668bed700 1 --2- 172.21.15.139:0/3520217325 >> v2:172.21.15.72:3300/0 conn(0x7f2664138990 0x7f26640a3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:51.855 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.844+0000 7f2668bed700 1 -- 172.21.15.139:0/3520217325 >> v1:172.21.15.139:6789/0 conn(0x7f2664066a30 legacy=0x7f2664148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:51.855 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.844+0000 7f26617fa700 1 -- 172.21.15.139:0/3520217325 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203623329 0 0) 0x7f26640a4520 con 0x7f2664066a30 2020-02-12T14:12:51.855 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.844+0000 7f2668bed700 1 -- 172.21.15.139:0/3520217325 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266413b510 con 0x7f266413ba20 2020-02-12T14:12:51.855 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.844+0000 7f2668bed700 1 --2- 172.21.15.139:0/3520217325 >> v2:172.21.15.139:3300/0 conn(0x7f266413ba20 0x7f266413b0b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f265c0032b0 tx=0x7f265c010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.856 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.844+0000 7f2668bed700 1 --2- 172.21.15.139:0/3520217325 >> v2:172.21.15.139:3300/0 conn(0x7f266413ba20 0x7f266413b0b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f265c0032b0 tx=0x7f265c010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.856 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.844+0000 7f2668bed700 1 --2- 172.21.15.139:0/3520217325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f266413ba20 0x7f266413b0b0 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7f265c0032b0 tx=0x7f265c010d20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:51.856 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.844+0000 7f2668bed700 1 --2- 172.21.15.139:0/3520217325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f266413ba20 0x7f266413b0b0 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f265c0032b0 tx=0x7f265c010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.856 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.844+0000 7f26617fa700 1 -- 172.21.15.139:0/3520217325 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f265c005e30 con 0x7f266413ba20 2020-02-12T14:12:51.856 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.844+0000 7f2668bed700 1 --2- 172.21.15.139:0/3520217325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f266413ba20 0x7f266413b0b0 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f265c0032b0 tx=0x7f265c010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.856 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.844+0000 7f2668bed700 1 --2- 172.21.15.139:0/3520217325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f266413ba20 0x7f266413b0b0 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f265c0032b0 tx=0x7f265c010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.857 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.844+0000 7f26617fa700 1 -- 172.21.15.139:0/3520217325 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265c007540 con 0x7f266413ba20 2020-02-12T14:12:51.857 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.844+0000 7f266a650700 1 -- 172.21.15.139:0/3520217325 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26641495f0 con 0x7f266413ba20 2020-02-12T14:12:51.857 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.844+0000 7f26617fa700 1 -- 172.21.15.139:0/3520217325 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f265c007920 con 0x7f266413ba20 2020-02-12T14:12:51.857 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.844+0000 7f266a650700 1 -- 172.21.15.139:0/3520217325 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2664131240 con 0x7f266413ba20 2020-02-12T14:12:51.857 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.845+0000 7f2668bed700 1 --2- 172.21.15.139:0/3520217325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f266413ba20 0x7f266413b0b0 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f265c0032b0 tx=0x7f265c010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.857 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.845+0000 7f26617fa700 1 -- 172.21.15.139:0/3520217325 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f265c012410 con 0x7f266413ba20 2020-02-12T14:12:51.857 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.845+0000 7f2668bed700 1 --2- 172.21.15.139:0/3520217325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f266413ba20 0x7f266413b0b0 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f265c0032b0 tx=0x7f265c010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.858 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.845+0000 7f26617fa700 1 --2- 172.21.15.139:0/3520217325 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f2644039a60 0x7f264403bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:51.858 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.845+0000 7f266a650700 1 -- 172.21.15.139:0/3520217325 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2664067e20 con 0x7f266413ba20 2020-02-12T14:12:51.858 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.845+0000 7f26617fa700 1 -- 172.21.15.139:0/3520217325 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f265c04a340 con 0x7f266413ba20 2020-02-12T14:12:51.858 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.845+0000 7f2663fff700 1 --2- 172.21.15.139:0/3520217325 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f2644039a60 0x7f264403bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:51.858 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.846+0000 7f2663fff700 1 --2- 172.21.15.139:0/3520217325 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f2644039a60 0x7f264403bf20 crc :-1 s=READY pgs=87 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:51.859 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.849+0000 7f2668bed700 1 --2- 172.21.15.139:0/3520217325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f266413ba20 0x7f266413b0b0 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f265c0032b0 tx=0x7f265c010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.859 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.849+0000 7f26617fa700 1 -- 172.21.15.139:0/3520217325 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f265c02f9b0 con 0x7f266413ba20 2020-02-12T14:12:51.983 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.982+0000 7f266a650700 1 -- 172.21.15.139:0/3520217325 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2664059fd0 con 0x7f266413ba20 2020-02-12T14:12:51.983 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.982+0000 7f2668bed700 1 --2- 172.21.15.139:0/3520217325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f266413ba20 0x7f266413b0b0 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f265c0032b0 tx=0x7f265c010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:51.984 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.982+0000 7f26617fa700 1 -- 172.21.15.139:0/3520217325 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f265c0324c0 con 0x7f266413ba20 2020-02-12T14:12:51.984 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 8 2020-02-12T14:12:51.985 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.983+0000 7f266a650700 1 -- 172.21.15.139:0/3520217325 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f2644039a60 msgr2=0x7f264403bf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:51.985 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.983+0000 7f266a650700 1 --2- 172.21.15.139:0/3520217325 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f2644039a60 0x7f264403bf20 crc :-1 s=READY pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:51.986 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.983+0000 7f266a650700 1 -- 172.21.15.139:0/3520217325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f266413ba20 msgr2=0x7f266413b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:51.986 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.983+0000 7f266a650700 1 --2- 172.21.15.139:0/3520217325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f266413ba20 0x7f266413b0b0 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7f265c0032b0 tx=0x7f265c010d20).stop 2020-02-12T14:12:51.986 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.984+0000 7f266a650700 1 -- 172.21.15.139:0/3520217325 shutdown_connections 2020-02-12T14:12:51.986 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.984+0000 7f266a650700 1 --2- 172.21.15.139:0/3520217325 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f2644039a60 0x7f264403bf20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:51.986 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.984+0000 7f266a650700 1 --2- 172.21.15.139:0/3520217325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f266413ba20 0x7f266413b0b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:51.986 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.984+0000 7f266a650700 1 --2- 172.21.15.139:0/3520217325 >> v2:172.21.15.72:3300/0 conn(0x7f2664138990 0x7f26640a3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:51.986 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.984+0000 7f266a650700 1 -- 172.21.15.139:0/3520217325 >> 172.21.15.139:0/3520217325 conn(0x7f2664060950 msgr2=0x7f26640a6560 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:51.987 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.984+0000 7f266a650700 1 -- 172.21.15.139:0/3520217325 shutdown_connections 2020-02-12T14:12:51.987 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:51.984+0000 7f266a650700 1 -- 172.21.15.139:0/3520217325 wait complete. 2020-02-12T14:12:51.995 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-02-12T14:12:52.102 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.101+0000 7f795b540700 1 Processor -- start 2020-02-12T14:12:52.102 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.101+0000 7f795b540700 1 -- start start 2020-02-12T14:12:52.113 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.102+0000 7f795b540700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f79540a3f40 0x7f7954134df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:52.113 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.102+0000 7f795b540700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79540a24a0 0x7f795412e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:52.113 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.102+0000 7f795b540700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79541359e0 con 0x7f7954135250 2020-02-12T14:12:52.113 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.102+0000 7f795b540700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7954135c80 con 0x7f79540a3f40 2020-02-12T14:12:52.114 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.102+0000 7f795b540700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79540a18f0 con 0x7f79540a24a0 2020-02-12T14:12:52.114 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.102+0000 7f7958adb700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f7954135250 0x7f79540a1d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35878/0 (socket says 172.21.15.139:35878) 2020-02-12T14:12:52.114 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.102+0000 7f7958adb700 1 -- 172.21.15.139:0/2917542843 learned_addr learned my addr 172.21.15.139:0/2917542843 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:52.114 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.102+0000 7f79592dc700 1 --2- 172.21.15.139:0/2917542843 >> v2:172.21.15.72:3300/0 conn(0x7f79540a3f40 0x7f7954134df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:52.114 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.102+0000 7f7959add700 1 --2- 172.21.15.139:0/2917542843 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79540a24a0 0x7f795412e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:52.114 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.102+0000 7f7943fff700 1 -- 172.21.15.139:0/2917542843 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170079349 0 0) 0x7f79541359e0 con 0x7f7954135250 2020-02-12T14:12:52.114 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.102+0000 7f7943fff700 1 -- 172.21.15.139:0/2917542843 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f793c003230 con 0x7f7954135250 2020-02-12T14:12:52.115 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.102+0000 7f7943fff700 1 -- 172.21.15.139:0/2917542843 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1943703722 0 0) 0x7f793c003230 con 0x7f7954135250 2020-02-12T14:12:52.115 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.102+0000 7f7943fff700 1 -- 172.21.15.139:0/2917542843 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79540a24a0 msgr2=0x7f795412e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:52.115 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.102+0000 7f7943fff700 1 --2- 172.21.15.139:0/2917542843 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79540a24a0 0x7f795412e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:52.115 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.102+0000 7f7943fff700 1 -- 172.21.15.139:0/2917542843 >> v2:172.21.15.72:3300/0 conn(0x7f79540a3f40 msgr2=0x7f7954134df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:52.115 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.102+0000 7f7943fff700 1 --2- 172.21.15.139:0/2917542843 >> v2:172.21.15.72:3300/0 conn(0x7f79540a3f40 0x7f7954134df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:52.115 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.102+0000 7f7943fff700 1 -- 172.21.15.139:0/2917542843 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79541356e0 con 0x7f7954135250 2020-02-12T14:12:52.115 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.102+0000 7f7943fff700 1 -- 172.21.15.139:0/2917542843 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7f79500016d0 con 0x7f7954135250 2020-02-12T14:12:52.115 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.102+0000 7f7943fff700 1 -- 172.21.15.139:0/2917542843 >> v1:172.21.15.139:6789/0 conn(0x7f7954135250 legacy=0x7f79540a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:52.116 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.102+0000 7f7943fff700 1 --2- 172.21.15.139:0/2917542843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f793c003720 0x7f793c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:52.116 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.102+0000 7f7943fff700 1 --2- 172.21.15.139:0/2917542843 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79540a24a0 0x7f793c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:52.116 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.103+0000 7f7943fff700 1 --2- 172.21.15.139:0/2917542843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f793c004930 0x7f793c004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:52.116 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.103+0000 7f7943fff700 1 -- 172.21.15.139:0/2917542843 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7954135c80 con 0x7f793c003720 2020-02-12T14:12:52.116 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.103+0000 7f7943fff700 1 -- 172.21.15.139:0/2917542843 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79540a18f0 con 0x7f793c004930 2020-02-12T14:12:52.116 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.103+0000 7f7943fff700 1 -- 172.21.15.139:0/2917542843 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793c0040f0 con 0x7f79540a24a0 2020-02-12T14:12:52.116 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.103+0000 7f79592dc700 1 --2- 172.21.15.139:0/2917542843 >> v2:172.21.15.72:3300/0 conn(0x7f79540a3f40 0x7f7954134df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T14:12:52.117 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.103+0000 7f7959add700 1 --2- 172.21.15.139:0/2917542843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f793c004930 0x7f793c004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:52.117 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.103+0000 7f7958adb700 1 --2- 172.21.15.139:0/2917542843 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79540a24a0 0x7f793c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:52.117 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.103+0000 7f79592dc700 1 --2- 172.21.15.139:0/2917542843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f793c003720 0x7f793c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:52.117 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.103+0000 7f7959add700 1 -- 172.21.15.139:0/2917542843 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79540a24a0 msgr2=0x7f793c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:52.117 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.103+0000 7f7959add700 1 --2- 172.21.15.139:0/2917542843 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79540a24a0 0x7f793c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:52.117 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.103+0000 7f7959add700 1 -- 172.21.15.139:0/2917542843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f793c003720 msgr2=0x7f793c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:52.117 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.103+0000 7f7959add700 1 --2- 172.21.15.139:0/2917542843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f793c003720 0x7f793c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:52.118 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.103+0000 7f7959add700 1 -- 172.21.15.139:0/2917542843 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c003230 con 0x7f793c004930 2020-02-12T14:12:52.118 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.103+0000 7f7959add700 1 --2- 172.21.15.139:0/2917542843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f793c004930 0x7f793c004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f794c008c90 tx=0x7f794c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.118 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.103+0000 7f7959add700 1 --2- 172.21.15.139:0/2917542843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f793c004930 0x7f793c004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f794c008c90 tx=0x7f794c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.118 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.103+0000 7f7959add700 1 --2- 172.21.15.139:0/2917542843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f793c004930 0x7f793c004db0 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7f794c008c90 tx=0x7f794c0103d0).ready entity=mon.1 client_cookie=13748a1a425e615 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:52.118 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.103+0000 7f7959add700 1 --2- 172.21.15.139:0/2917542843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f793c004930 0x7f793c004db0 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f794c008c90 tx=0x7f794c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.118 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.103+0000 7f7943fff700 1 -- 172.21.15.139:0/2917542843 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f794c005c30 con 0x7f793c004930 2020-02-12T14:12:52.118 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.103+0000 7f7959add700 1 --2- 172.21.15.139:0/2917542843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f793c004930 0x7f793c004db0 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f794c008c90 tx=0x7f794c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.119 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.103+0000 7f7959add700 1 --2- 172.21.15.139:0/2917542843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f793c004930 0x7f793c004db0 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f794c008c90 tx=0x7f794c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.119 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.103+0000 7f7943fff700 1 -- 172.21.15.139:0/2917542843 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c005d90 con 0x7f793c004930 2020-02-12T14:12:52.119 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.103+0000 7f7943fff700 1 -- 172.21.15.139:0/2917542843 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f794c0112b0 con 0x7f793c004930 2020-02-12T14:12:52.119 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.103+0000 7f795b540700 1 -- 172.21.15.139:0/2917542843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f793c004930 msgr2=0x7f793c004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:52.119 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.103+0000 7f795b540700 1 --2- 172.21.15.139:0/2917542843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f793c004930 0x7f793c004db0 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7f794c008c90 tx=0x7f794c0103d0).stop 2020-02-12T14:12:52.119 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.103+0000 7f7959add700 1 -- 172.21.15.139:0/2917542843 reap_dead start 2020-02-12T14:12:52.119 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.104+0000 7f795b540700 1 -- 172.21.15.139:0/2917542843 shutdown_connections 2020-02-12T14:12:52.119 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.104+0000 7f795b540700 1 -- 172.21.15.139:0/2917542843 >> 172.21.15.139:0/2917542843 conn(0x7f7954060950 msgr2=0x7f795409d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:52.120 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.104+0000 7f795b540700 1 -- 172.21.15.139:0/2917542843 shutdown_connections 2020-02-12T14:12:52.120 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.104+0000 7f795b540700 1 -- 172.21.15.139:0/2917542843 wait complete. 2020-02-12T14:12:52.120 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.104+0000 7f795b540700 1 Processor -- start 2020-02-12T14:12:52.120 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.104+0000 7f795b540700 1 -- start start 2020-02-12T14:12:52.120 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.105+0000 7f795b540700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7954134da0 0x7f795409f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:52.120 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.105+0000 7f795b540700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79540a04e0 0x7f79540a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:52.120 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.105+0000 7f795b540700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7954147a00 con 0x7f7954065f60 2020-02-12T14:12:52.120 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.105+0000 7f795b540700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79540a4ab0 con 0x7f7954134da0 2020-02-12T14:12:52.121 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.105+0000 7f795b540700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7954066ab0 con 0x7f79540a04e0 2020-02-12T14:12:52.121 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.105+0000 7f79592dc700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7954134da0 0x7f795409f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:52.121 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.105+0000 7f79592dc700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7954134da0 0x7f795409f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47250/0 (socket says 172.21.15.139:47250) 2020-02-12T14:12:52.121 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.105+0000 7f79592dc700 1 -- 172.21.15.139:0/1269527270 learned_addr learned my addr 172.21.15.139:0/1269527270 (peer_addr_for_me v2:172.21.15.139:0/0) 2020-02-12T14:12:52.121 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.105+0000 7f7958adb700 1 --2- 172.21.15.139:0/1269527270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79540a04e0 0x7f79540a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:52.121 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.105+0000 7f79592dc700 1 -- 172.21.15.139:0/1269527270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79540a04e0 msgr2=0x7f79540a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:52.121 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.105+0000 7f79592dc700 1 --2- 172.21.15.139:0/1269527270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79540a04e0 0x7f79540a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:52.122 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.105+0000 7f79592dc700 1 -- 172.21.15.139:0/1269527270 >> v1:172.21.15.72:6789/0 conn(0x7f7954065f60 legacy=0x7f79540663a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:52.122 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.105+0000 7f79592dc700 1 -- 172.21.15.139:0/1269527270 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79540a7880 con 0x7f7954134da0 2020-02-12T14:12:52.122 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.105+0000 7f7958adb700 1 --2- 172.21.15.139:0/1269527270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79540a04e0 0x7f79540a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T14:12:52.122 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.105+0000 7f79592dc700 1 --2- 172.21.15.139:0/1269527270 >> v2:172.21.15.139:3300/0 conn(0x7f7954134da0 0x7f795409f1d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7944007fa0 tx=0x7f7944010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.122 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.105+0000 7f79592dc700 1 --2- 172.21.15.139:0/1269527270 >> v2:172.21.15.139:3300/0 conn(0x7f7954134da0 0x7f795409f1d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7944007fa0 tx=0x7f7944010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.122 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.106+0000 7f79592dc700 1 --2- 172.21.15.139:0/1269527270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7954134da0 0x7f795409f1d0 secure :-1 s=READY pgs=211 cs=0 l=1 rx=0x7f7944007fa0 tx=0x7f7944010cf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:52.122 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.106+0000 7f79592dc700 1 --2- 172.21.15.139:0/1269527270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7954134da0 0x7f795409f1d0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f7944007fa0 tx=0x7f7944010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.123 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.106+0000 7f79592dc700 1 --2- 172.21.15.139:0/1269527270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7954134da0 0x7f795409f1d0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f7944007fa0 tx=0x7f7944010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.123 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.106+0000 7f79427fc700 1 -- 172.21.15.139:0/1269527270 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7944007540 con 0x7f7954134da0 2020-02-12T14:12:52.124 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.106+0000 7f79592dc700 1 --2- 172.21.15.139:0/1269527270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7954134da0 0x7f795409f1d0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f7944007fa0 tx=0x7f7944010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.124 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.106+0000 7f79427fc700 1 -- 172.21.15.139:0/1269527270 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79440059c0 con 0x7f7954134da0 2020-02-12T14:12:52.124 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.106+0000 7f795b540700 1 -- 172.21.15.139:0/1269527270 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795409f750 con 0x7f7954134da0 2020-02-12T14:12:52.124 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.106+0000 7f79427fc700 1 -- 172.21.15.139:0/1269527270 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7944005d20 con 0x7f7954134da0 2020-02-12T14:12:52.124 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.106+0000 7f795b540700 1 -- 172.21.15.139:0/1269527270 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7954146ad0 con 0x7f7954134da0 2020-02-12T14:12:52.124 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.106+0000 7f79592dc700 1 --2- 172.21.15.139:0/1269527270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7954134da0 0x7f795409f1d0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f7944007fa0 tx=0x7f7944010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.124 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.106+0000 7f79427fc700 1 -- 172.21.15.139:0/1269527270 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f7944009440 con 0x7f7954134da0 2020-02-12T14:12:52.125 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.106+0000 7f79592dc700 1 --2- 172.21.15.139:0/1269527270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7954134da0 0x7f795409f1d0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f7944007fa0 tx=0x7f7944010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.125 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.107+0000 7f79427fc700 1 --2- 172.21.15.139:0/1269527270 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f7934039c50 0x7f793403c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:52.125 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.107+0000 7f79427fc700 1 -- 172.21.15.139:0/1269527270 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f7944049ec0 con 0x7f7954134da0 2020-02-12T14:12:52.125 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.107+0000 7f7958adb700 1 --2- 172.21.15.139:0/1269527270 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f7934039c50 0x7f793403c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:52.125 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.107+0000 7f795b540700 1 -- 172.21.15.139:0/1269527270 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79540a01f0 con 0x7f7954134da0 2020-02-12T14:12:52.125 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.107+0000 7f7958adb700 1 --2- 172.21.15.139:0/1269527270 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f7934039c50 0x7f793403c110 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:52.125 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.110+0000 7f79592dc700 1 --2- 172.21.15.139:0/1269527270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7954134da0 0x7f795409f1d0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f7944007fa0 tx=0x7f7944010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.126 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.110+0000 7f79427fc700 1 -- 172.21.15.139:0/1269527270 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f794402f450 con 0x7f7954134da0 2020-02-12T14:12:52.249 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.248+0000 7f795b540700 1 -- 172.21.15.139:0/1269527270 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7954067e20 con 0x7f7954134da0 2020-02-12T14:12:52.250 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.248+0000 7f79592dc700 1 --2- 172.21.15.139:0/1269527270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7954134da0 0x7f795409f1d0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f7944007fa0 tx=0x7f7944010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.250 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.248+0000 7f79427fc700 1 -- 172.21.15.139:0/1269527270 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f7944031f40 con 0x7f7954134da0 2020-02-12T14:12:52.250 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 8 2020-02-12T14:12:52.251 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.249+0000 7f795b540700 1 -- 172.21.15.139:0/1269527270 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f7934039c50 msgr2=0x7f793403c110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:52.251 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.249+0000 7f795b540700 1 --2- 172.21.15.139:0/1269527270 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f7934039c50 0x7f793403c110 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:52.252 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.249+0000 7f795b540700 1 -- 172.21.15.139:0/1269527270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7954134da0 msgr2=0x7f795409f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:52.252 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.249+0000 7f795b540700 1 --2- 172.21.15.139:0/1269527270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7954134da0 0x7f795409f1d0 secure :-1 s=READY pgs=211 cs=0 l=1 rx=0x7f7944007fa0 tx=0x7f7944010cf0).stop 2020-02-12T14:12:52.252 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.250+0000 7f795b540700 1 -- 172.21.15.139:0/1269527270 shutdown_connections 2020-02-12T14:12:52.252 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.250+0000 7f795b540700 1 --2- 172.21.15.139:0/1269527270 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f7934039c50 0x7f793403c110 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:52.252 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.250+0000 7f795b540700 1 --2- 172.21.15.139:0/1269527270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7954134da0 0x7f795409f1d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:52.252 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.250+0000 7f795b540700 1 --2- 172.21.15.139:0/1269527270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79540a04e0 0x7f79540a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:52.253 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.250+0000 7f795b540700 1 -- 172.21.15.139:0/1269527270 >> 172.21.15.139:0/1269527270 conn(0x7f7954060950 msgr2=0x7f795405e850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:52.253 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.250+0000 7f795b540700 1 -- 172.21.15.139:0/1269527270 shutdown_connections 2020-02-12T14:12:52.253 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.250+0000 7f795b540700 1 -- 172.21.15.139:0/1269527270 wait complete. 2020-02-12T14:12:52.261 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-02-12T14:12:52.261 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-02-12T14:12:52.366 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.365+0000 7fa01b0cc700 1 Processor -- start 2020-02-12T14:12:52.367 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.365+0000 7fa01b0cc700 1 -- start start 2020-02-12T14:12:52.375 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.366+0000 7fa01b0cc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa014135500 0x7fa0140a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:52.375 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.366+0000 7fa01b0cc700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa0140a21f0 0x7fa01412e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T14:12:52.375 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.366+0000 7fa01b0cc700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0141359e0 con 0x7fa0140a3f40 2020-02-12T14:12:52.375 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.366+0000 7fa01b0cc700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa014135c80 con 0x7fa014135500 2020-02-12T14:12:52.376 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.366+0000 7fa01b0cc700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0140a18f0 con 0x7fa0140a21f0 2020-02-12T14:12:52.376 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.366+0000 7fa019669700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa0140a21f0 0x7fa01412e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:52.376 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.366+0000 7fa018e68700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fa0140a3f40 0x7fa014134df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35896/0 (socket says 172.21.15.139:35896) 2020-02-12T14:12:52.376 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.366+0000 7fa019669700 1 --2- 172.21.15.139:0/2136865440 >> v2:172.21.15.139:3300/0 conn(0x7fa0140a21f0 0x7fa01412e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47258/0 (socket says 172.21.15.139:47258) 2020-02-12T14:12:52.376 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.366+0000 7fa018e68700 1 -- 172.21.15.139:0/2136865440 learned_addr learned my addr 172.21.15.139:0/2136865440 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:52.376 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.366+0000 7fa013fff700 1 --2- 172.21.15.139:0/2136865440 >> v2:172.21.15.72:3300/0 conn(0x7fa014135500 0x7fa0140a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:52.377 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.366+0000 7fa019669700 1 -- 172.21.15.139:0/2136865440 >> v2:172.21.15.72:3300/0 conn(0x7fa014135500 msgr2=0x7fa0140a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T14:12:52.377 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.366+0000 7fa019669700 1 --2- 172.21.15.139:0/2136865440 >> v2:172.21.15.72:3300/0 conn(0x7fa014135500 0x7fa0140a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:52.377 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.366+0000 7fa019669700 1 -- 172.21.15.139:0/2136865440 >> v1:172.21.15.139:6789/0 conn(0x7fa0140a3f40 legacy=0x7fa014134df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:52.377 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.366+0000 7fa019669700 1 -- 172.21.15.139:0/2136865440 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0140a2680 con 0x7fa0140a21f0 2020-02-12T14:12:52.377 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.366+0000 7fa0137fe700 1 -- 172.21.15.139:0/2136865440 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352629321 0 0) 0x7fa0141359e0 con 0x7fa0140a3f40 2020-02-12T14:12:52.377 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.367+0000 7fa019669700 1 --2- 172.21.15.139:0/2136865440 >> v2:172.21.15.139:3300/0 conn(0x7fa0140a21f0 0x7fa01412e6b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa00c0032b0 tx=0x7fa00c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.377 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.367+0000 7fa019669700 1 --2- 172.21.15.139:0/2136865440 >> v2:172.21.15.139:3300/0 conn(0x7fa0140a21f0 0x7fa01412e6b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa00c0032b0 tx=0x7fa00c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.377 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.367+0000 7fa019669700 1 --2- 172.21.15.139:0/2136865440 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0140a21f0 0x7fa01412e6b0 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7fa00c0032b0 tx=0x7fa00c007dc0).ready entity=mon.1 client_cookie=3d83dbd4419c0b53 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:52.378 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.367+0000 7fa019669700 1 --2- 172.21.15.139:0/2136865440 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0140a21f0 0x7fa01412e6b0 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7fa00c0032b0 tx=0x7fa00c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.378 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.367+0000 7fa0137fe700 1 -- 172.21.15.139:0/2136865440 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa00c00a350 con 0x7fa0140a21f0 2020-02-12T14:12:52.378 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.367+0000 7fa019669700 1 --2- 172.21.15.139:0/2136865440 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0140a21f0 0x7fa01412e6b0 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7fa00c0032b0 tx=0x7fa00c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.378 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.367+0000 7fa019669700 1 --2- 172.21.15.139:0/2136865440 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0140a21f0 0x7fa01412e6b0 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7fa00c0032b0 tx=0x7fa00c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.378 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.367+0000 7fa0137fe700 1 -- 172.21.15.139:0/2136865440 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00c00a4b0 con 0x7fa0140a21f0 2020-02-12T14:12:52.378 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.367+0000 7fa0137fe700 1 -- 172.21.15.139:0/2136865440 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa00c00a850 con 0x7fa0140a21f0 2020-02-12T14:12:52.378 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.367+0000 7fa01b0cc700 1 -- 172.21.15.139:0/2136865440 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0140a21f0 msgr2=0x7fa01412e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:52.379 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.367+0000 7fa01b0cc700 1 --2- 172.21.15.139:0/2136865440 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0140a21f0 0x7fa01412e6b0 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7fa00c0032b0 tx=0x7fa00c007dc0).stop 2020-02-12T14:12:52.379 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.367+0000 7fa01b0cc700 1 -- 172.21.15.139:0/2136865440 shutdown_connections 2020-02-12T14:12:52.379 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.367+0000 7fa01b0cc700 1 --2- 172.21.15.139:0/2136865440 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0140a21f0 0x7fa01412e6b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:52.379 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.367+0000 7fa01b0cc700 1 --2- 172.21.15.139:0/2136865440 >> v2:172.21.15.72:3300/0 conn(0x7fa014135500 0x7fa0140a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T14:12:52.379 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.367+0000 7fa01b0cc700 1 -- 172.21.15.139:0/2136865440 >> 172.21.15.139:0/2136865440 conn(0x7fa014060950 msgr2=0x7fa01409d530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:52.379 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.367+0000 7fa01b0cc700 1 -- 172.21.15.139:0/2136865440 shutdown_connections 2020-02-12T14:12:52.379 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.367+0000 7fa01b0cc700 1 -- 172.21.15.139:0/2136865440 wait complete. 2020-02-12T14:12:52.379 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.368+0000 7fa01b0cc700 1 Processor -- start 2020-02-12T14:12:52.380 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.368+0000 7fa01b0cc700 1 -- start start 2020-02-12T14:12:52.380 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.369+0000 7fa01b0cc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa014135500 0x7fa014128e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:52.380 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.369+0000 7fa01b0cc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa01412d980 con 0x7fa0140a21f0 2020-02-12T14:12:52.380 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.369+0000 7fa01b0cc700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa01412de50 con 0x7fa0140a3f40 2020-02-12T14:12:52.380 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.369+0000 7fa01b0cc700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa01412fd30 con 0x7fa014135500 2020-02-12T14:12:52.380 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.369+0000 7fa013fff700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fa0140a3f40 0x7fa0141496b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35904/0 (socket says 172.21.15.139:35904) 2020-02-12T14:12:52.380 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.369+0000 7fa013fff700 1 -- 172.21.15.139:0/4224042150 learned_addr learned my addr 172.21.15.139:0/4224042150 (peer_addr_for_me v1:172.21.15.139:0/0) 2020-02-12T14:12:52.381 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.369+0000 7fa019669700 1 --2- 172.21.15.139:0/4224042150 >> v2:172.21.15.72:3300/0 conn(0x7fa014135500 0x7fa014128e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:52.381 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.369+0000 7fa011ffb700 1 -- 172.21.15.139:0/4224042150 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3247050164 0 0) 0x7fa01412de50 con 0x7fa0140a3f40 2020-02-12T14:12:52.381 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.369+0000 7fa011ffb700 1 -- 172.21.15.139:0/4224042150 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ff4002fe0 con 0x7fa0140a3f40 2020-02-12T14:12:52.381 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.369+0000 7fa011ffb700 1 -- 172.21.15.139:0/4224042150 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164193885 0 0) 0x7fa01412d980 con 0x7fa0140a21f0 2020-02-12T14:12:52.381 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.369+0000 7fa011ffb700 1 -- 172.21.15.139:0/4224042150 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa01412de50 con 0x7fa0140a21f0 2020-02-12T14:12:52.381 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.369+0000 7fa011ffb700 1 -- 172.21.15.139:0/4224042150 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2730549778 0 0) 0x7f9ff4002fe0 con 0x7fa0140a3f40 2020-02-12T14:12:52.381 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.369+0000 7fa011ffb700 1 -- 172.21.15.139:0/4224042150 --> v1:172.21.15.139:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa01412d980 con 0x7fa0140a3f40 2020-02-12T14:12:52.381 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.369+0000 7fa011ffb700 1 -- 172.21.15.139:0/4224042150 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2753668074 0 0) 0x7fa008001550 con 0x7fa0140a3f40 2020-02-12T14:12:52.382 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.369+0000 7fa011ffb700 1 -- 172.21.15.139:0/4224042150 >> v2:172.21.15.72:3300/0 conn(0x7fa014135500 msgr2=0x7fa014128e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:52.382 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.369+0000 7fa011ffb700 1 --2- 172.21.15.139:0/4224042150 >> v2:172.21.15.72:3300/0 conn(0x7fa014135500 0x7fa014128e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:52.382 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.369+0000 7fa011ffb700 1 -- 172.21.15.139:0/4224042150 >> v1:172.21.15.139:6789/0 conn(0x7fa0140a3f40 legacy=0x7fa0141496b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:52.382 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.369+0000 7fa011ffb700 1 -- 172.21.15.139:0/4224042150 >> v1:172.21.15.72:6789/0 conn(0x7fa0140a21f0 legacy=0x7fa014128750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:52.382 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.369+0000 7fa011ffb700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ff4004b20 0x7f9ff4004f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:52.382 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.369+0000 7fa011ffb700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ff4003ab0 0x7f9ff4003f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:52.382 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.369+0000 7fa011ffb700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ff4004370 0x7f9ff400b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:52.382 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.369+0000 7fa011ffb700 1 -- 172.21.15.139:0/4224042150 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01412fd30 con 0x7f9ff4004370 2020-02-12T14:12:52.383 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.369+0000 7fa011ffb700 1 -- 172.21.15.139:0/4224042150 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff400bbb0 con 0x7f9ff4004b20 2020-02-12T14:12:52.383 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.370+0000 7fa011ffb700 1 -- 172.21.15.139:0/4224042150 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff400bcf0 con 0x7f9ff4003ab0 2020-02-12T14:12:52.383 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.370+0000 7fa018e68700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ff4004b20 0x7f9ff4004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:52.383 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.370+0000 7fa013fff700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ff4003ab0 0x7f9ff4003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:52.383 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.370+0000 7fa019669700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ff4004370 0x7f9ff400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:52.383 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.370+0000 7fa018e68700 1 -- 172.21.15.139:0/4224042150 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ff4003ab0 msgr2=0x7f9ff4003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:52.383 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.370+0000 7fa018e68700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ff4003ab0 0x7f9ff4003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:52.384 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.370+0000 7fa018e68700 1 -- 172.21.15.139:0/4224042150 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ff4004370 msgr2=0x7f9ff400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:52.384 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.370+0000 7fa018e68700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ff4004370 0x7f9ff400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:52.384 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.370+0000 7fa018e68700 1 -- 172.21.15.139:0/4224042150 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0140671d0 con 0x7f9ff4004b20 2020-02-12T14:12:52.384 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.370+0000 7fa01b0cc700 1 -- 172.21.15.139:0/4224042150 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa01412dbb0 con 0x7f9ff4004b20 2020-02-12T14:12:52.384 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.370+0000 7fa013fff700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ff4003ab0 0x7f9ff4003f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T14:12:52.384 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.370+0000 7fa019669700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ff4004370 0x7f9ff400b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T14:12:52.384 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.370+0000 7fa019669700 1 -- 172.21.15.139:0/4224042150 reap_dead start 2020-02-12T14:12:52.384 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.370+0000 7fa018e68700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ff4004b20 0x7f9ff4004f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa004000ee0 tx=0x7fa00400c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.385 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.370+0000 7fa01b0cc700 1 -- 172.21.15.139:0/4224042150 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa01412e390 con 0x7f9ff4004b20 2020-02-12T14:12:52.385 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.370+0000 7fa018e68700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ff4004b20 0x7f9ff4004f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa004000ee0 tx=0x7fa00400c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.385 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.370+0000 7fa018e68700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ff4004b20 0x7f9ff4004f20 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7fa004000ee0 tx=0x7fa00400c5f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:52.385 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.370+0000 7fa018e68700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ff4004b20 0x7f9ff4004f20 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fa004000ee0 tx=0x7fa00400c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.385 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.370+0000 7fa011ffb700 1 -- 172.21.15.139:0/4224042150 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa00400c950 con 0x7f9ff4004b20 2020-02-12T14:12:52.385 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.370+0000 7fa018e68700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ff4004b20 0x7f9ff4004f20 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fa004000ee0 tx=0x7fa00400c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.385 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.370+0000 7fa011ffb700 1 -- 172.21.15.139:0/4224042150 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00400caf0 con 0x7f9ff4004b20 2020-02-12T14:12:52.386 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.370+0000 7fa018e68700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ff4004b20 0x7f9ff4004f20 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fa004000ee0 tx=0x7fa00400c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.386 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.370+0000 7fa011ffb700 1 -- 172.21.15.139:0/4224042150 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0040055c0 con 0x7f9ff4004b20 2020-02-12T14:12:52.386 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.371+0000 7fa018e68700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ff4004b20 0x7f9ff4004f20 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fa004000ee0 tx=0x7fa00400c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.386 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.371+0000 7fa01b0cc700 1 -- 172.21.15.139:0/4224042150 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff0003340 con 0x7f9ff4004b20 2020-02-12T14:12:52.386 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.371+0000 7fa011ffb700 1 -- 172.21.15.139:0/4224042150 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fa004005720 con 0x7f9ff4004b20 2020-02-12T14:12:52.386 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.371+0000 7fa018e68700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ff4004b20 0x7f9ff4004f20 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fa004000ee0 tx=0x7fa00400c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.386 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.371+0000 7fa011ffb700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f9ff403de60 0x7f9ff4040320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T14:12:52.387 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.371+0000 7fa011ffb700 1 -- 172.21.15.139:0/4224042150 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fa0040496b0 con 0x7f9ff4004b20 2020-02-12T14:12:52.387 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.371+0000 7fa013fff700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f9ff403de60 0x7f9ff4040320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T14:12:52.387 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.371+0000 7fa013fff700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f9ff403de60 0x7f9ff4040320 crc :-1 s=READY pgs=89 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T14:12:52.387 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.374+0000 7fa018e68700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ff4004b20 0x7f9ff4004f20 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fa004000ee0 tx=0x7fa00400c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.388 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.374+0000 7fa011ffb700 1 -- 172.21.15.139:0/4224042150 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fa00402ed80 con 0x7f9ff4004b20 2020-02-12T14:12:52.555 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.553+0000 7fa01b0cc700 1 -- 172.21.15.139:0/4224042150 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ff00036e0 con 0x7f9ff4004b20 2020-02-12T14:12:52.555 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.554+0000 7fa018e68700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ff4004b20 0x7f9ff4004f20 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fa004000ee0 tx=0x7fa00400c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T14:12:52.555 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.554+0000 7fa011ffb700 1 -- 172.21.15.139:0/4224042150 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2207 (secure 0 0 0) 0x7fa0040100b0 con 0x7f9ff4004b20 2020-02-12T14:12:52.556 INFO:teuthology.orchestra.run.smithi139.stdout: 2020-02-12T14:12:52.556 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/4257142488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":4257142488},{"type":"v1","addr":"172.21.15.72:6833","nonce":4257142488}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-02-12T14:12:39.448075+0000","modified":"2020-02-12T14:12:51.164549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.139:6835/2764306457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2764306457},{"type":"v1","addr":"172.21.15.139:6835","nonce":2764306457}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-02-12T14:12:52.557 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.555+0000 7fa01b0cc700 1 -- 172.21.15.139:0/4224042150 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f9ff403de60 msgr2=0x7f9ff4040320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:52.557 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.555+0000 7fa01b0cc700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f9ff403de60 0x7f9ff4040320 crc :-1 s=READY pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:52.558 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.555+0000 7fa01b0cc700 1 -- 172.21.15.139:0/4224042150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ff4004b20 msgr2=0x7f9ff4004f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T14:12:52.558 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.555+0000 7fa01b0cc700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ff4004b20 0x7f9ff4004f20 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7fa004000ee0 tx=0x7fa00400c5f0).stop 2020-02-12T14:12:52.558 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.555+0000 7fa01b0cc700 1 -- 172.21.15.139:0/4224042150 shutdown_connections 2020-02-12T14:12:52.558 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.555+0000 7fa01b0cc700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.139:6800/21203,v1:172.21.15.139:6801/21203] conn(0x7f9ff403de60 0x7f9ff4040320 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:52.558 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.555+0000 7fa01b0cc700 1 --2- 172.21.15.139:0/4224042150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ff4004b20 0x7f9ff4004f20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T14:12:52.558 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.555+0000 7fa01b0cc700 1 -- 172.21.15.139:0/4224042150 >> 172.21.15.139:0/4224042150 conn(0x7fa014060950 msgr2=0x7fa01405b150 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T14:12:52.558 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.555+0000 7fa01b0cc700 1 -- 172.21.15.139:0/4224042150 shutdown_connections 2020-02-12T14:12:52.559 INFO:teuthology.orchestra.run.smithi139.stderr:2020-02-12T14:12:52.555+0000 7fa01b0cc700 1 -- 172.21.15.139:0/4224042150 wait complete. 2020-02-12T14:12:52.559 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 7 2020-02-12T14:12:52.768 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4378}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 7, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_7': u'mds uses inline data', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [3], u'info': {u'gid_4378': {u'export_targets': [], u'name': u'a', u'incarnation': 5, u'state_seq': 2, u'state': u'up:active', u'gid': 4378, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 2764306457, u'type': u'v2', u'addr': u'172.21.15.139:6834'}, {u'nonce': 2764306457, u'type': u'v1', u'addr': u'172.21.15.139:6835'}]}, u'addr': u'172.21.15.139:6835/2764306457'}}, u'fs_name': u'cephfs', u'created': u'2020-02-12T14:12:39.448075+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-02-12T14:12:51.164549+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-02-12T14:12:52.768 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-02-12T14:12:52.768 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-02-12T14:12:52.886 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2020-02-12T14:12:52.886 INFO:teuthology.orchestra.run.smithi139.stdout: "cluster_fsid": "dacc9a6c-9e88-46ac-940b-c4a329dbffec", 2020-02-12T14:12:52.886 INFO:teuthology.orchestra.run.smithi139.stdout: "whoami": 0, 2020-02-12T14:12:52.887 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4378, 2020-02-12T14:12:52.887 INFO:teuthology.orchestra.run.smithi139.stdout: "want_state": "up:active", 2020-02-12T14:12:52.887 INFO:teuthology.orchestra.run.smithi139.stdout: "state": "up:active", 2020-02-12T14:12:52.887 INFO:teuthology.orchestra.run.smithi139.stdout: "rank_uptime": 10.742713459000001, 2020-02-12T14:12:52.887 INFO:teuthology.orchestra.run.smithi139.stdout: "mdsmap_epoch": 7, 2020-02-12T14:12:52.887 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch": 23, 2020-02-12T14:12:52.887 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch_barrier": 23, 2020-02-12T14:12:52.888 INFO:teuthology.orchestra.run.smithi139.stdout: "uptime": 11.087020045999999 2020-02-12T14:12:52.888 INFO:teuthology.orchestra.run.smithi139.stdout:} 2020-02-12T14:12:52.895 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "dacc9a6c-9e88-46ac-940b-c4a329dbffec", "whoami": 0, "id": 4378, "want_state": "up:active", "state": "up:active", "rank_uptime": 10.742713459000001, "mdsmap_epoch": 7, "osdmap_epoch": 23, "osdmap_epoch_barrier": 23, "uptime": 11.087020045999999 } 2020-02-12T14:12:52.895 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-02-12T14:12:52.896 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-02-12T14:12:52.896 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi139.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-02-12T14:12:52.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-12T14:12:52.897 INFO:teuthology.orchestra.run.smithi139:> mkdir -p /home/ubuntu/cephtest/mnt.0 2020-02-12T14:12:52.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-12T14:12:52.917 INFO:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-02-12T14:12:52.979 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-02-12T14:12:52.988 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2020-02-12T14:12:52.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-12T14:12:52.988 INFO:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2020-02-12T14:12:53.033 DEBUG:teuthology.orchestra.run:got remote process result: 2 2020-02-12T14:12:53.037 INFO:teuthology.orchestra.run.smithi139.stderr:ls: cannot access '/sys/fs/fuse/connections': No such file or directory 2020-02-12T14:12:53.038 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-02-12T14:12:53.038 INFO:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0 2020-02-12T14:12:53.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-12T14:12:53.075 INFO:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-02-12T14:12:53.101 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-02-12T14:12:53.110 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2020-02-12T14:12:53.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-12T14:12:53.110 INFO:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2020-02-12T14:12:53.148 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:2020-02-12T14:12:53.147+0000 7f26d2f011c0 -1 init, newargv = 0x5609a6c18240 newargc=7 2020-02-12T14:12:53.149 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[25273]: starting ceph client 2020-02-12T14:12:53.157 DEBUG:teuthology.orchestra.run:got remote process result: 2 2020-02-12T14:12:53.162 INFO:teuthology.orchestra.run.smithi139.stderr:ls: cannot access '/sys/fs/fuse/connections': No such file or directory 2020-02-12T14:12:53.189 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[25273]: starting fuse 2020-02-12T14:12:54.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-12T14:12:54.263 INFO:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-02-12T14:12:54.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-12T14:12:54.300 INFO:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2020-02-12T14:12:54.356 INFO:teuthology.orchestra.run.smithi139.stdout:45 2020-02-12T14:12:54.356 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2020-02-12T14:12:54.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-12T14:12:54.357 INFO:teuthology.orchestra.run.smithi139:> sudo python3 -c ' 2020-02-12T14:12:54.357 INFO:teuthology.orchestra.run.smithi139:> import glob 2020-02-12T14:12:54.357 INFO:teuthology.orchestra.run.smithi139:> import re 2020-02-12T14:12:54.357 INFO:teuthology.orchestra.run.smithi139:> import os 2020-02-12T14:12:54.357 INFO:teuthology.orchestra.run.smithi139:> import subprocess 2020-02-12T14:12:54.357 INFO:teuthology.orchestra.run.smithi139:> 2020-02-12T14:12:54.357 INFO:teuthology.orchestra.run.smithi139:> def find_socket(client_name): 2020-02-12T14:12:54.358 INFO:teuthology.orchestra.run.smithi139:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-02-12T14:12:54.358 INFO:teuthology.orchestra.run.smithi139:> files = glob.glob(asok_path) 2020-02-12T14:12:54.358 INFO:teuthology.orchestra.run.smithi139:> 2020-02-12T14:12:54.358 INFO:teuthology.orchestra.run.smithi139:> # Given a non-glob path, it better be there 2020-02-12T14:12:54.358 INFO:teuthology.orchestra.run.smithi139:> if "*" not in asok_path: 2020-02-12T14:12:54.358 INFO:teuthology.orchestra.run.smithi139:> assert(len(files) == 1) 2020-02-12T14:12:54.358 INFO:teuthology.orchestra.run.smithi139:> return files[0] 2020-02-12T14:12:54.358 INFO:teuthology.orchestra.run.smithi139:> 2020-02-12T14:12:54.359 INFO:teuthology.orchestra.run.smithi139:> for f in files: 2020-02-12T14:12:54.359 INFO:teuthology.orchestra.run.smithi139:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-02-12T14:12:54.359 INFO:teuthology.orchestra.run.smithi139:> if os.path.exists("/proc/{0}".format(pid)): 2020-02-12T14:12:54.359 INFO:teuthology.orchestra.run.smithi139:> return f 2020-02-12T14:12:54.359 INFO:teuthology.orchestra.run.smithi139:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-02-12T14:12:54.359 INFO:teuthology.orchestra.run.smithi139:> 2020-02-12T14:12:54.359 INFO:teuthology.orchestra.run.smithi139:> print(find_socket("client.0")) 2020-02-12T14:12:54.359 INFO:teuthology.orchestra.run.smithi139:> ' 2020-02-12T14:12:54.460 INFO:teuthology.orchestra.run.smithi139.stdout:/var/run/ceph/ceph-client.0.25273.asok 2020-02-12T14:12:54.460 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.25273.asok 2020-02-12T14:12:54.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-12T14:12:54.461 INFO:teuthology.orchestra.run.smithi139:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.25273.asok status 2020-02-12T14:12:54.578 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2020-02-12T14:12:54.579 INFO:teuthology.orchestra.run.smithi139.stdout: "metadata": { 2020-02-12T14:12:54.579 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_sha1": "7df2194963eaa185d198b9c90e899c7e7ae9eb30", 2020-02-12T14:12:54.579 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 15.1.0-567-g7df2194 (7df2194963eaa185d198b9c90e899c7e7ae9eb30) octopus (rc)", 2020-02-12T14:12:54.579 INFO:teuthology.orchestra.run.smithi139.stdout: "entity_id": "0", 2020-02-12T14:12:54.579 INFO:teuthology.orchestra.run.smithi139.stdout: "hostname": "smithi139", 2020-02-12T14:12:54.579 INFO:teuthology.orchestra.run.smithi139.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-02-12T14:12:54.580 INFO:teuthology.orchestra.run.smithi139.stdout: "pid": "25273", 2020-02-12T14:12:54.580 INFO:teuthology.orchestra.run.smithi139.stdout: "root": "/" 2020-02-12T14:12:54.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2020-02-12T14:12:54.580 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_count": 0, 2020-02-12T14:12:54.580 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_pinned_count": 0, 2020-02-12T14:12:54.580 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4693, 2020-02-12T14:12:54.580 INFO:teuthology.orchestra.run.smithi139.stdout: "inst": { 2020-02-12T14:12:54.581 INFO:teuthology.orchestra.run.smithi139.stdout: "name": { 2020-02-12T14:12:54.581 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "client", 2020-02-12T14:12:54.581 INFO:teuthology.orchestra.run.smithi139.stdout: "num": 4693 2020-02-12T14:12:54.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2020-02-12T14:12:54.581 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2020-02-12T14:12:54.581 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2020-02-12T14:12:54.581 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2020-02-12T14:12:54.581 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 3452778217 2020-02-12T14:12:54.582 INFO:teuthology.orchestra.run.smithi139.stdout: } 2020-02-12T14:12:54.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2020-02-12T14:12:54.582 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2020-02-12T14:12:54.582 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2020-02-12T14:12:54.582 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2020-02-12T14:12:54.582 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 3452778217 2020-02-12T14:12:54.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2020-02-12T14:12:54.583 INFO:teuthology.orchestra.run.smithi139.stdout: "inst_str": "client.4693 172.21.15.139:0/3452778217", 2020-02-12T14:12:54.583 INFO:teuthology.orchestra.run.smithi139.stdout: "addr_str": "172.21.15.139:0/3452778217", 2020-02-12T14:12:54.583 INFO:teuthology.orchestra.run.smithi139.stdout: "inode_count": 1, 2020-02-12T14:12:54.583 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_epoch": 7, 2020-02-12T14:12:54.583 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch": 23, 2020-02-12T14:12:54.583 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch_barrier": 0, 2020-02-12T14:12:54.584 INFO:teuthology.orchestra.run.smithi139.stdout: "blacklisted": false 2020-02-12T14:12:54.584 INFO:teuthology.orchestra.run.smithi139.stdout:} 2020-02-12T14:12:54.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-12T14:12:54.584 INFO:teuthology.orchestra.run.smithi139:> stat --file-system '--printf=%T 2020-02-12T14:12:54.584 INFO:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0 2020-02-12T14:12:54.602 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2020-02-12T14:12:54.603 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-02-12T14:12:54.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-12T14:12:54.603 INFO:teuthology.orchestra.run.smithi139:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2020-02-12T14:12:54.677 INFO:teuthology.run_tasks:Running task workunit... 2020-02-12T14:12:54.694 INFO:tasks.workunit:Pulling workunits from ref 7df2194963eaa185d198b9c90e899c7e7ae9eb30 2020-02-12T14:12:54.694 INFO:tasks.workunit:Making a separate scratch dir for every client... 2020-02-12T14:12:54.694 INFO:tasks.workunit:timeout=6h 2020-02-12T14:12:54.694 INFO:tasks.workunit:cleanup=True 2020-02-12T14:12:54.695 INFO:teuthology.orchestra.run.smithi139:> stat -- /home/ubuntu/cephtest/mnt.0 2020-02-12T14:12:54.721 INFO:teuthology.orchestra.run.smithi139.stdout: File: /home/ubuntu/cephtest/mnt.0 2020-02-12T14:12:54.722 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2020-02-12T14:12:54.722 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 2dh/45d Inode: 1 Links: 2 2020-02-12T14:12:54.722 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-12T14:12:54.722 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:fusefs_t:s0 2020-02-12T14:12:54.722 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2020-02-12T14:12:54.723 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2020-02-12 14:12:42.143647231 +0000 2020-02-12T14:12:54.723 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2020-02-12 14:12:54.664263786 +0000 2020-02-12T14:12:54.723 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2020-02-12T14:12:54.723 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2020-02-12T14:12:54.723 INFO:teuthology.orchestra.run.smithi139:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2020-02-12T14:12:54.795 INFO:teuthology.orchestra.run.smithi139:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7df2194963eaa185d198b9c90e899c7e7ae9eb30 2020-02-12T14:12:54.903 INFO:tasks.workunit.client.0.smithi139.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2020-02-12T14:13:08.038 INFO:tasks.ceph.mon.b.smithi072.stderr:terminate called after throwing an instance of 'std::out_of_range' 2020-02-12T14:13:08.038 INFO:tasks.ceph.mon.b.smithi072.stderr: what(): map::at 2020-02-12T14:13:08.038 INFO:tasks.ceph.mon.b.smithi072.stderr:*** Caught signal (Aborted) ** 2020-02-12T14:13:08.038 INFO:tasks.ceph.mon.b.smithi072.stderr: in thread 7fa0bd2ea700 thread_name:safe_timer 2020-02-12T14:13:08.039 INFO:tasks.ceph.mon.b.smithi072.stderr: ceph version 15.1.0-567-g7df2194 (7df2194963eaa185d198b9c90e899c7e7ae9eb30) octopus (rc) 2020-02-12T14:13:08.039 INFO:tasks.ceph.mon.b.smithi072.stderr: 1: (()+0x12dc0) [0x7fa0c5ebadc0] 2020-02-12T14:13:08.039 INFO:tasks.ceph.mon.b.smithi072.stderr: 2: (gsignal()+0x10f) [0x7fa0c4b958df] 2020-02-12T14:13:08.039 INFO:tasks.ceph.mon.b.smithi072.stderr: 3: (abort()+0x127) [0x7fa0c4b7fcf5] 2020-02-12T14:13:08.039 INFO:tasks.ceph.mon.b.smithi072.stderr: 4: (()+0x9006b) [0x7fa0c554b06b] 2020-02-12T14:13:08.039 INFO:tasks.ceph.mon.b.smithi072.stderr: 5: (()+0x964cc) [0x7fa0c55514cc] 2020-02-12T14:13:08.040 INFO:tasks.ceph.mon.b.smithi072.stderr: 6: (()+0x96527) [0x7fa0c5551527] 2020-02-12T14:13:08.040 INFO:tasks.ceph.mon.b.smithi072.stderr: 7: (()+0x96788) [0x7fa0c5551788] 2020-02-12T14:13:08.040 INFO:tasks.ceph.mon.b.smithi072.stderr: 8: (()+0x9200f) [0x7fa0c554d00f] 2020-02-12T14:13:08.040 INFO:tasks.ceph.mon.b.smithi072.stderr: 9: (FSMap::find_replacement_for(mds_role_t) const+0x127) [0x7fa0c8661ff7] 2020-02-12T14:13:08.040 INFO:tasks.ceph.mon.b.smithi072.stderr: 10: (MDSMonitor::check_ranks(FSMap&, bool*)+0x4ff) [0x556df1cbb04f] 2020-02-12T14:13:08.040 INFO:tasks.ceph.mon.b.smithi072.stderr: 11: (MDSMonitor::tick()+0x32b) [0x556df1cbc40b] 2020-02-12T14:13:08.040 INFO:tasks.ceph.mon.b.smithi072.stderr: 12: (Monitor::tick()+0x140) [0x556df1adb260] 2020-02-12T14:13:08.040 INFO:tasks.ceph.mon.b.smithi072.stderr: 13: (Context::complete(int)+0xd) [0x556df1af2c0d] 2020-02-12T14:13:08.041 INFO:tasks.ceph.mon.b.smithi072.stderr: 14: (SafeTimer::timer_thread()+0x1b7) [0x7fa0c8247617] 2020-02-12T14:13:08.041 INFO:tasks.ceph.mon.b.smithi072.stderr: 15: (SafeTimerThread::entry()+0x11) [0x7fa0c8248bf1] 2020-02-12T14:13:08.041 INFO:tasks.ceph.mon.b.smithi072.stderr: 16: (()+0x82de) [0x7fa0c5eb02de] 2020-02-12T14:13:08.041 INFO:tasks.ceph.mon.b.smithi072.stderr: 17: (clone()+0x43) [0x7fa0c4c5a133] 2020-02-12T14:13:08.041 INFO:tasks.ceph.mon.b.smithi072.stderr:2020-02-12T14:13:08.038+0000 7fa0bd2ea700 -1 *** Caught signal (Aborted) ** 2020-02-12T14:13:08.041 INFO:tasks.ceph.mon.b.smithi072.stderr: in thread 7fa0bd2ea700 thread_name:safe_timer 2020-02-12T14:13:08.042 INFO:tasks.ceph.mon.b.smithi072.stderr: 2020-02-12T14:13:08.042 INFO:tasks.ceph.mon.b.smithi072.stderr: ceph version 15.1.0-567-g7df2194 (7df2194963eaa185d198b9c90e899c7e7ae9eb30) octopus (rc) 2020-02-12T14:13:08.042 INFO:tasks.ceph.mon.b.smithi072.stderr: 1: (()+0x12dc0) [0x7fa0c5ebadc0] 2020-02-12T14:13:08.042 INFO:tasks.ceph.mon.b.smithi072.stderr: 2: (gsignal()+0x10f) [0x7fa0c4b958df] 2020-02-12T14:13:08.042 INFO:tasks.ceph.mon.b.smithi072.stderr: 3: (abort()+0x127) [0x7fa0c4b7fcf5] 2020-02-12T14:13:08.042 INFO:tasks.ceph.mon.b.smithi072.stderr: 4: (()+0x9006b) [0x7fa0c554b06b] 2020-02-12T14:13:08.042 INFO:tasks.ceph.mon.b.smithi072.stderr: 5: (()+0x964cc) [0x7fa0c55514cc] 2020-02-12T14:13:08.043 INFO:tasks.ceph.mon.b.smithi072.stderr: 6: (()+0x96527) [0x7fa0c5551527] 2020-02-12T14:13:08.043 INFO:tasks.ceph.mon.b.smithi072.stderr: 7: (()+0x96788) [0x7fa0c5551788] 2020-02-12T14:13:08.043 INFO:tasks.ceph.mon.b.smithi072.stderr: 8: (()+0x9200f) [0x7fa0c554d00f] 2020-02-12T14:13:08.043 INFO:tasks.ceph.mon.b.smithi072.stderr: 9: (FSMap::find_replacement_for(mds_role_t) const+0x127) [0x7fa0c8661ff7] 2020-02-12T14:13:08.043 INFO:tasks.ceph.mon.b.smithi072.stderr: 10: (MDSMonitor::check_ranks(FSMap&, bool*)+0x4ff) [0x556df1cbb04f] 2020-02-12T14:13:08.043 INFO:tasks.ceph.mon.b.smithi072.stderr: 11: (MDSMonitor::tick()+0x32b) [0x556df1cbc40b] 2020-02-12T14:13:08.043 INFO:tasks.ceph.mon.b.smithi072.stderr: 12: (Monitor::tick()+0x140) [0x556df1adb260] 2020-02-12T14:13:08.043 INFO:tasks.ceph.mon.b.smithi072.stderr: 13: (Context::complete(int)+0xd) [0x556df1af2c0d] 2020-02-12T14:13:08.044 INFO:tasks.ceph.mon.b.smithi072.stderr: 14: (SafeTimer::timer_thread()+0x1b7) [0x7fa0c8247617] 2020-02-12T14:13:08.044 INFO:tasks.ceph.mon.b.smithi072.stderr: 15: (SafeTimerThread::entry()+0x11) [0x7fa0c8248bf1] 2020-02-12T14:13:08.044 INFO:tasks.ceph.mon.b.smithi072.stderr: 16: (()+0x82de) [0x7fa0c5eb02de] 2020-02-12T14:13:08.044 INFO:tasks.ceph.mon.b.smithi072.stderr: 17: (clone()+0x43) [0x7fa0c4c5a133] 2020-02-12T14:13:08.044 INFO:tasks.ceph.mon.b.smithi072.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-02-12T14:13:08.044 INFO:tasks.ceph.mon.b.smithi072.stderr: 2020-02-12T14:13:08.054 INFO:tasks.ceph.mon.b.smithi072.stderr: 0> 2020-02-12T14:13:08.038+0000 7fa0bd2ea700 -1 *** Caught signal (Aborted) ** 2020-02-12T14:13:08.055 INFO:tasks.ceph.mon.b.smithi072.stderr: in thread 7fa0bd2ea700 thread_name:safe_timer 2020-02-12T14:13:08.055 INFO:tasks.ceph.mon.b.smithi072.stderr: 2020-02-12T14:13:08.055 INFO:tasks.ceph.mon.b.smithi072.stderr: ceph version 15.1.0-567-g7df2194 (7df2194963eaa185d198b9c90e899c7e7ae9eb30) octopus (rc) 2020-02-12T14:13:08.055 INFO:tasks.ceph.mon.b.smithi072.stderr: 1: (()+0x12dc0) [0x7fa0c5ebadc0] 2020-02-12T14:13:08.055 INFO:tasks.ceph.mon.b.smithi072.stderr: 2: (gsignal()+0x10f) [0x7fa0c4b958df] 2020-02-12T14:13:08.055 INFO:tasks.ceph.mon.b.smithi072.stderr: 3: (abort()+0x127) [0x7fa0c4b7fcf5] 2020-02-12T14:13:08.055 INFO:tasks.ceph.mon.b.smithi072.stderr: 4: (()+0x9006b) [0x7fa0c554b06b] 2020-02-12T14:13:08.056 INFO:tasks.ceph.mon.b.smithi072.stderr: 5: (()+0x964cc) [0x7fa0c55514cc] 2020-02-12T14:13:08.056 INFO:tasks.ceph.mon.b.smithi072.stderr: 6: (()+0x96527) [0x7fa0c5551527] 2020-02-12T14:13:08.056 INFO:tasks.ceph.mon.b.smithi072.stderr: 7: (()+0x96788) [0x7fa0c5551788] 2020-02-12T14:13:08.056 INFO:tasks.ceph.mon.b.smithi072.stderr: 8: (()+0x9200f) [0x7fa0c554d00f] 2020-02-12T14:13:08.056 INFO:tasks.ceph.mon.b.smithi072.stderr: 9: (FSMap::find_replacement_for(mds_role_t) const+0x127) [0x7fa0c8661ff7] 2020-02-12T14:13:08.056 INFO:tasks.ceph.mon.b.smithi072.stderr: 10: (MDSMonitor::check_ranks(FSMap&, bool*)+0x4ff) [0x556df1cbb04f] 2020-02-12T14:13:08.056 INFO:tasks.ceph.mon.b.smithi072.stderr: 11: (MDSMonitor::tick()+0x32b) [0x556df1cbc40b] 2020-02-12T14:13:08.056 INFO:tasks.ceph.mon.b.smithi072.stderr: 12: (Monitor::tick()+0x140) [0x556df1adb260] 2020-02-12T14:13:08.057 INFO:tasks.ceph.mon.b.smithi072.stderr: 13: (Context::complete(int)+0xd) [0x556df1af2c0d] 2020-02-12T14:13:08.057 INFO:tasks.ceph.mon.b.smithi072.stderr: 14: (SafeTimer::timer_thread()+0x1b7) [0x7fa0c8247617] 2020-02-12T14:13:08.057 INFO:tasks.ceph.mon.b.smithi072.stderr: 15: (SafeTimerThread::entry()+0x11) [0x7fa0c8248bf1] 2020-02-12T14:13:08.057 INFO:tasks.ceph.mon.b.smithi072.stderr: 16: (()+0x82de) [0x7fa0c5eb02de] 2020-02-12T14:13:08.057 INFO:tasks.ceph.mon.b.smithi072.stderr: 17: (clone()+0x43) [0x7fa0c4c5a133] 2020-02-12T14:13:08.057 INFO:tasks.ceph.mon.b.smithi072.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-02-12T14:13:08.057 INFO:tasks.ceph.mon.b.smithi072.stderr: 2020-02-12T14:13:08.065 INFO:tasks.ceph.mon.b.smithi072.stderr: 0> 2020-02-12T14:13:08.038+0000 7fa0bd2ea700 -1 *** Caught signal (Aborted) ** 2020-02-12T14:13:08.065 INFO:tasks.ceph.mon.b.smithi072.stderr: in thread 7fa0bd2ea700 thread_name:safe_timer 2020-02-12T14:13:08.066 INFO:tasks.ceph.mon.b.smithi072.stderr: 2020-02-12T14:13:08.066 INFO:tasks.ceph.mon.b.smithi072.stderr: ceph version 15.1.0-567-g7df2194 (7df2194963eaa185d198b9c90e899c7e7ae9eb30) octopus (rc) 2020-02-12T14:13:08.066 INFO:tasks.ceph.mon.b.smithi072.stderr: 1: (()+0x12dc0) [0x7fa0c5ebadc0] 2020-02-12T14:13:08.066 INFO:tasks.ceph.mon.b.smithi072.stderr: 2: (gsignal()+0x10f) [0x7fa0c4b958df] 2020-02-12T14:13:08.066 INFO:tasks.ceph.mon.b.smithi072.stderr: 3: (abort()+0x127) [0x7fa0c4b7fcf5] 2020-02-12T14:13:08.066 INFO:tasks.ceph.mon.b.smithi072.stderr: 4: (()+0x9006b) [0x7fa0c554b06b] 2020-02-12T14:13:08.066 INFO:tasks.ceph.mon.b.smithi072.stderr: 5: (()+0x964cc) [0x7fa0c55514cc] 2020-02-12T14:13:08.066 INFO:tasks.ceph.mon.b.smithi072.stderr: 6: (()+0x96527) [0x7fa0c5551527] 2020-02-12T14:13:08.067 INFO:tasks.ceph.mon.b.smithi072.stderr: 7: (()+0x96788) [0x7fa0c5551788] 2020-02-12T14:13:08.067 INFO:tasks.ceph.mon.b.smithi072.stderr: 8: (()+0x9200f) [0x7fa0c554d00f] 2020-02-12T14:13:08.067 INFO:tasks.ceph.mon.b.smithi072.stderr: 9: (FSMap::find_replacement_for(mds_role_t) const+0x127) [0x7fa0c8661ff7] 2020-02-12T14:13:08.067 INFO:tasks.ceph.mon.b.smithi072.stderr: 10: (MDSMonitor::check_ranks(FSMap&, bool*)+0x4ff) [0x556df1cbb04f] 2020-02-12T14:13:08.067 INFO:tasks.ceph.mon.b.smithi072.stderr: 11: (MDSMonitor::tick()+0x32b) [0x556df1cbc40b] 2020-02-12T14:13:08.067 INFO:tasks.ceph.mon.b.smithi072.stderr: 12: (Monitor::tick()+0x140) [0x556df1adb260] 2020-02-12T14:13:08.067 INFO:tasks.ceph.mon.b.smithi072.stderr: 13: (Context::complete(int)+0xd) [0x556df1af2c0d] 2020-02-12T14:13:08.067 INFO:tasks.ceph.mon.b.smithi072.stderr: 14: (SafeTimer::timer_thread()+0x1b7) [0x7fa0c8247617] 2020-02-12T14:13:08.068 INFO:tasks.ceph.mon.b.smithi072.stderr: 15: (SafeTimerThread::entry()+0x11) [0x7fa0c8248bf1] 2020-02-12T14:13:08.068 INFO:tasks.ceph.mon.b.smithi072.stderr: 16: (()+0x82de) [0x7fa0c5eb02de] 2020-02-12T14:13:08.068 INFO:tasks.ceph.mon.b.smithi072.stderr: 17: (clone()+0x43) [0x7fa0c4c5a133] 2020-02-12T14:13:08.068 INFO:tasks.ceph.mon.b.smithi072.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-02-12T14:13:08.068 INFO:tasks.ceph.mon.b.smithi072.stderr: 2020-02-12T14:13:08.481 INFO:tasks.ceph.mon.b.smithi072.stderr:daemon-helper: command crashed with signal 6 2020-02-12T14:13:09.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2020-02-12T14:13:10.537 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:13:10.540 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:13:15.733 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~6s 2020-02-12T14:13:22.145 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~13s 2020-02-12T14:13:28.556 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~19s 2020-02-12T14:13:34.971 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~26s 2020-02-12T14:13:38.067 INFO:tasks.ceph.mon.a.smithi139.stderr:terminate called after throwing an instance of 'std::out_of_range' 2020-02-12T14:13:38.067 INFO:tasks.ceph.mon.a.smithi139.stderr: what(): map::at 2020-02-12T14:13:38.067 INFO:tasks.ceph.mon.a.smithi139.stderr:*** Caught signal (Aborted) ** 2020-02-12T14:13:38.067 INFO:tasks.ceph.mon.a.smithi139.stderr: in thread 7fc3e69fd700 thread_name:safe_timer 2020-02-12T14:13:38.068 INFO:tasks.ceph.mon.a.smithi139.stderr: ceph version 15.1.0-567-g7df2194 (7df2194963eaa185d198b9c90e899c7e7ae9eb30) octopus (rc) 2020-02-12T14:13:38.068 INFO:tasks.ceph.mon.a.smithi139.stderr: 1: (()+0x12dc0) [0x7fc3ef5cddc0] 2020-02-12T14:13:38.068 INFO:tasks.ceph.mon.a.smithi139.stderr: 2: (gsignal()+0x10f) [0x7fc3ee2a88df] 2020-02-12T14:13:38.068 INFO:tasks.ceph.mon.a.smithi139.stderr: 3: (abort()+0x127) [0x7fc3ee292cf5] 2020-02-12T14:13:38.068 INFO:tasks.ceph.mon.a.smithi139.stderr: 4: (()+0x9006b) [0x7fc3eec5e06b] 2020-02-12T14:13:38.069 INFO:tasks.ceph.mon.a.smithi139.stderr: 5: (()+0x964cc) [0x7fc3eec644cc] 2020-02-12T14:13:38.069 INFO:tasks.ceph.mon.a.smithi139.stderr: 6: (()+0x96527) [0x7fc3eec64527] 2020-02-12T14:13:38.069 INFO:tasks.ceph.mon.a.smithi139.stderr: 7: (()+0x96788) [0x7fc3eec64788] 2020-02-12T14:13:38.069 INFO:tasks.ceph.mon.a.smithi139.stderr: 8: (()+0x9200f) [0x7fc3eec6000f] 2020-02-12T14:13:38.069 INFO:tasks.ceph.mon.a.smithi139.stderr: 9: (FSMap::find_replacement_for(mds_role_t) const+0x127) [0x7fc3f1d74ff7] 2020-02-12T14:13:38.069 INFO:tasks.ceph.mon.a.smithi139.stderr: 10: (MDSMonitor::check_ranks(FSMap&, bool*)+0x4ff) [0x561d28dfa04f] 2020-02-12T14:13:38.069 INFO:tasks.ceph.mon.a.smithi139.stderr: 11: (MDSMonitor::tick()+0x32b) [0x561d28dfb40b] 2020-02-12T14:13:38.069 INFO:tasks.ceph.mon.a.smithi139.stderr: 12: (Monitor::tick()+0x140) [0x561d28c1a260] 2020-02-12T14:13:38.070 INFO:tasks.ceph.mon.a.smithi139.stderr: 13: (Context::complete(int)+0xd) [0x561d28c31c0d] 2020-02-12T14:13:38.070 INFO:tasks.ceph.mon.a.smithi139.stderr: 14: (SafeTimer::timer_thread()+0x1b7) [0x7fc3f195a617] 2020-02-12T14:13:38.070 INFO:tasks.ceph.mon.a.smithi139.stderr: 15: (SafeTimerThread::entry()+0x11) [0x7fc3f195bbf1] 2020-02-12T14:13:38.070 INFO:tasks.ceph.mon.a.smithi139.stderr: 16: (()+0x82de) [0x7fc3ef5c32de] 2020-02-12T14:13:38.070 INFO:tasks.ceph.mon.a.smithi139.stderr: 17: (clone()+0x43) [0x7fc3ee36d133] 2020-02-12T14:13:38.070 INFO:tasks.ceph.mon.a.smithi139.stderr:2020-02-12T14:13:38.067+0000 7fc3e69fd700 -1 *** Caught signal (Aborted) ** 2020-02-12T14:13:38.070 INFO:tasks.ceph.mon.a.smithi139.stderr: in thread 7fc3e69fd700 thread_name:safe_timer 2020-02-12T14:13:38.071 INFO:tasks.ceph.mon.a.smithi139.stderr: 2020-02-12T14:13:38.071 INFO:tasks.ceph.mon.a.smithi139.stderr: ceph version 15.1.0-567-g7df2194 (7df2194963eaa185d198b9c90e899c7e7ae9eb30) octopus (rc) 2020-02-12T14:13:38.071 INFO:tasks.ceph.mon.a.smithi139.stderr: 1: (()+0x12dc0) [0x7fc3ef5cddc0] 2020-02-12T14:13:38.071 INFO:tasks.ceph.mon.a.smithi139.stderr: 2: (gsignal()+0x10f) [0x7fc3ee2a88df] 2020-02-12T14:13:38.071 INFO:tasks.ceph.mon.a.smithi139.stderr: 3: (abort()+0x127) [0x7fc3ee292cf5] 2020-02-12T14:13:38.071 INFO:tasks.ceph.mon.a.smithi139.stderr: 4: (()+0x9006b) [0x7fc3eec5e06b] 2020-02-12T14:13:38.071 INFO:tasks.ceph.mon.a.smithi139.stderr: 5: (()+0x964cc) [0x7fc3eec644cc] 2020-02-12T14:13:38.071 INFO:tasks.ceph.mon.a.smithi139.stderr: 6: (()+0x96527) [0x7fc3eec64527] 2020-02-12T14:13:38.072 INFO:tasks.ceph.mon.a.smithi139.stderr: 7: (()+0x96788) [0x7fc3eec64788] 2020-02-12T14:13:38.072 INFO:tasks.ceph.mon.a.smithi139.stderr: 8: (()+0x9200f) [0x7fc3eec6000f] 2020-02-12T14:13:38.072 INFO:tasks.ceph.mon.a.smithi139.stderr: 9: (FSMap::find_replacement_for(mds_role_t) const+0x127) [0x7fc3f1d74ff7] 2020-02-12T14:13:38.072 INFO:tasks.ceph.mon.a.smithi139.stderr: 10: (MDSMonitor::check_ranks(FSMap&, bool*)+0x4ff) [0x561d28dfa04f] 2020-02-12T14:13:38.072 INFO:tasks.ceph.mon.a.smithi139.stderr: 11: (MDSMonitor::tick()+0x32b) [0x561d28dfb40b] 2020-02-12T14:13:38.072 INFO:tasks.ceph.mon.a.smithi139.stderr: 12: (Monitor::tick()+0x140) [0x561d28c1a260] 2020-02-12T14:13:38.072 INFO:tasks.ceph.mon.a.smithi139.stderr: 13: (Context::complete(int)+0xd) [0x561d28c31c0d] 2020-02-12T14:13:38.072 INFO:tasks.ceph.mon.a.smithi139.stderr: 14: (SafeTimer::timer_thread()+0x1b7) [0x7fc3f195a617] 2020-02-12T14:13:38.073 INFO:tasks.ceph.mon.a.smithi139.stderr: 15: (SafeTimerThread::entry()+0x11) [0x7fc3f195bbf1] 2020-02-12T14:13:38.073 INFO:tasks.ceph.mon.a.smithi139.stderr: 16: (()+0x82de) [0x7fc3ef5c32de] 2020-02-12T14:13:38.073 INFO:tasks.ceph.mon.a.smithi139.stderr: 17: (clone()+0x43) [0x7fc3ee36d133] 2020-02-12T14:13:38.073 INFO:tasks.ceph.mon.a.smithi139.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-02-12T14:13:38.073 INFO:tasks.ceph.mon.a.smithi139.stderr: 2020-02-12T14:13:38.083 INFO:tasks.ceph.mon.a.smithi139.stderr: 0> 2020-02-12T14:13:38.067+0000 7fc3e69fd700 -1 *** Caught signal (Aborted) ** 2020-02-12T14:13:38.083 INFO:tasks.ceph.mon.a.smithi139.stderr: in thread 7fc3e69fd700 thread_name:safe_timer 2020-02-12T14:13:38.083 INFO:tasks.ceph.mon.a.smithi139.stderr: 2020-02-12T14:13:38.083 INFO:tasks.ceph.mon.a.smithi139.stderr: ceph version 15.1.0-567-g7df2194 (7df2194963eaa185d198b9c90e899c7e7ae9eb30) octopus (rc) 2020-02-12T14:13:38.083 INFO:tasks.ceph.mon.a.smithi139.stderr: 1: (()+0x12dc0) [0x7fc3ef5cddc0] 2020-02-12T14:13:38.084 INFO:tasks.ceph.mon.a.smithi139.stderr: 2: (gsignal()+0x10f) [0x7fc3ee2a88df] 2020-02-12T14:13:38.084 INFO:tasks.ceph.mon.a.smithi139.stderr: 3: (abort()+0x127) [0x7fc3ee292cf5] 2020-02-12T14:13:38.084 INFO:tasks.ceph.mon.a.smithi139.stderr: 4: (()+0x9006b) [0x7fc3eec5e06b] 2020-02-12T14:13:38.084 INFO:tasks.ceph.mon.a.smithi139.stderr: 5: (()+0x964cc) [0x7fc3eec644cc] 2020-02-12T14:13:38.084 INFO:tasks.ceph.mon.a.smithi139.stderr: 6: (()+0x96527) [0x7fc3eec64527] 2020-02-12T14:13:38.084 INFO:tasks.ceph.mon.a.smithi139.stderr: 7: (()+0x96788) [0x7fc3eec64788] 2020-02-12T14:13:38.084 INFO:tasks.ceph.mon.a.smithi139.stderr: 8: (()+0x9200f) [0x7fc3eec6000f] 2020-02-12T14:13:38.084 INFO:tasks.ceph.mon.a.smithi139.stderr: 9: (FSMap::find_replacement_for(mds_role_t) const+0x127) [0x7fc3f1d74ff7] 2020-02-12T14:13:38.085 INFO:tasks.ceph.mon.a.smithi139.stderr: 10: (MDSMonitor::check_ranks(FSMap&, bool*)+0x4ff) [0x561d28dfa04f] 2020-02-12T14:13:38.085 INFO:tasks.ceph.mon.a.smithi139.stderr: 11: (MDSMonitor::tick()+0x32b) [0x561d28dfb40b] 2020-02-12T14:13:38.085 INFO:tasks.ceph.mon.a.smithi139.stderr: 12: (Monitor::tick()+0x140) [0x561d28c1a260] 2020-02-12T14:13:38.085 INFO:tasks.ceph.mon.a.smithi139.stderr: 13: (Context::complete(int)+0xd) [0x561d28c31c0d] 2020-02-12T14:13:38.085 INFO:tasks.ceph.mon.a.smithi139.stderr: 14: (SafeTimer::timer_thread()+0x1b7) [0x7fc3f195a617] 2020-02-12T14:13:38.085 INFO:tasks.ceph.mon.a.smithi139.stderr: 15: (SafeTimerThread::entry()+0x11) [0x7fc3f195bbf1] 2020-02-12T14:13:38.085 INFO:tasks.ceph.mon.a.smithi139.stderr: 16: (()+0x82de) [0x7fc3ef5c32de] 2020-02-12T14:13:38.086 INFO:tasks.ceph.mon.a.smithi139.stderr: 17: (clone()+0x43) [0x7fc3ee36d133] 2020-02-12T14:13:38.086 INFO:tasks.ceph.mon.a.smithi139.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-02-12T14:13:38.086 INFO:tasks.ceph.mon.a.smithi139.stderr: 2020-02-12T14:13:38.093 INFO:tasks.ceph.mon.a.smithi139.stderr: 0> 2020-02-12T14:13:38.067+0000 7fc3e69fd700 -1 *** Caught signal (Aborted) ** 2020-02-12T14:13:38.093 INFO:tasks.ceph.mon.a.smithi139.stderr: in thread 7fc3e69fd700 thread_name:safe_timer 2020-02-12T14:13:38.093 INFO:tasks.ceph.mon.a.smithi139.stderr: 2020-02-12T14:13:38.094 INFO:tasks.ceph.mon.a.smithi139.stderr: ceph version 15.1.0-567-g7df2194 (7df2194963eaa185d198b9c90e899c7e7ae9eb30) octopus (rc) 2020-02-12T14:13:38.094 INFO:tasks.ceph.mon.a.smithi139.stderr: 1: (()+0x12dc0) [0x7fc3ef5cddc0] 2020-02-12T14:13:38.094 INFO:tasks.ceph.mon.a.smithi139.stderr: 2: (gsignal()+0x10f) [0x7fc3ee2a88df] 2020-02-12T14:13:38.094 INFO:tasks.ceph.mon.a.smithi139.stderr: 3: (abort()+0x127) [0x7fc3ee292cf5] 2020-02-12T14:13:38.094 INFO:tasks.ceph.mon.a.smithi139.stderr: 4: (()+0x9006b) [0x7fc3eec5e06b] 2020-02-12T14:13:38.094 INFO:tasks.ceph.mon.a.smithi139.stderr: 5: (()+0x964cc) [0x7fc3eec644cc] 2020-02-12T14:13:38.094 INFO:tasks.ceph.mon.a.smithi139.stderr: 6: (()+0x96527) [0x7fc3eec64527] 2020-02-12T14:13:38.095 INFO:tasks.ceph.mon.a.smithi139.stderr: 7: (()+0x96788) [0x7fc3eec64788] 2020-02-12T14:13:38.095 INFO:tasks.ceph.mon.a.smithi139.stderr: 8: (()+0x9200f) [0x7fc3eec6000f] 2020-02-12T14:13:38.095 INFO:tasks.ceph.mon.a.smithi139.stderr: 9: (FSMap::find_replacement_for(mds_role_t) const+0x127) [0x7fc3f1d74ff7] 2020-02-12T14:13:38.095 INFO:tasks.ceph.mon.a.smithi139.stderr: 10: (MDSMonitor::check_ranks(FSMap&, bool*)+0x4ff) [0x561d28dfa04f] 2020-02-12T14:13:38.095 INFO:tasks.ceph.mon.a.smithi139.stderr: 11: (MDSMonitor::tick()+0x32b) [0x561d28dfb40b] 2020-02-12T14:13:38.095 INFO:tasks.ceph.mon.a.smithi139.stderr: 12: (Monitor::tick()+0x140) [0x561d28c1a260] 2020-02-12T14:13:38.095 INFO:tasks.ceph.mon.a.smithi139.stderr: 13: (Context::complete(int)+0xd) [0x561d28c31c0d] 2020-02-12T14:13:38.095 INFO:tasks.ceph.mon.a.smithi139.stderr: 14: (SafeTimer::timer_thread()+0x1b7) [0x7fc3f195a617] 2020-02-12T14:13:38.096 INFO:tasks.ceph.mon.a.smithi139.stderr: 15: (SafeTimerThread::entry()+0x11) [0x7fc3f195bbf1] 2020-02-12T14:13:38.096 INFO:tasks.ceph.mon.a.smithi139.stderr: 16: (()+0x82de) [0x7fc3ef5c32de] 2020-02-12T14:13:38.096 INFO:tasks.ceph.mon.a.smithi139.stderr: 17: (clone()+0x43) [0x7fc3ee36d133] 2020-02-12T14:13:38.096 INFO:tasks.ceph.mon.a.smithi139.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-02-12T14:13:38.096 INFO:tasks.ceph.mon.a.smithi139.stderr: 2020-02-12T14:13:38.555 INFO:tasks.ceph.mon.a.smithi139.stderr:daemon-helper: command crashed with signal 6 2020-02-12T14:13:40.616 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:13:40.620 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:13:41.283 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2020-02-12T14:13:41.283 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~32s 2020-02-12T14:13:47.594 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~6s 2020-02-12T14:13:47.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~38s 2020-02-12T14:13:53.907 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~13s 2020-02-12T14:13:53.907 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~45s 2020-02-12T14:14:00.219 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~19s 2020-02-12T14:14:00.219 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~51s 2020-02-12T14:14:06.532 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~25s 2020-02-12T14:14:06.532 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~57s 2020-02-12T14:14:10.685 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:14:10.688 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:14:12.845 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~32s 2020-02-12T14:14:12.845 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~64s 2020-02-12T14:14:19.157 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~38s 2020-02-12T14:14:19.157 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~70s 2020-02-12T14:14:25.469 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~44s 2020-02-12T14:14:25.470 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~76s 2020-02-12T14:14:31.782 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~50s 2020-02-12T14:14:31.782 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~83s 2020-02-12T14:14:38.094 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~57s 2020-02-12T14:14:38.094 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~89s 2020-02-12T14:14:40.761 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:14:40.764 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:14:40.977 INFO:tasks.workunit.client.0.smithi139.stderr:Note: checking out '7df2194963eaa185d198b9c90e899c7e7ae9eb30'. 2020-02-12T14:14:40.977 INFO:tasks.workunit.client.0.smithi139.stderr: 2020-02-12T14:14:40.977 INFO:tasks.workunit.client.0.smithi139.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2020-02-12T14:14:40.977 INFO:tasks.workunit.client.0.smithi139.stderr:changes and commit them, and you can discard any commits you make in this 2020-02-12T14:14:40.978 INFO:tasks.workunit.client.0.smithi139.stderr:state without impacting any branches by performing another checkout. 2020-02-12T14:14:40.978 INFO:tasks.workunit.client.0.smithi139.stderr: 2020-02-12T14:14:40.978 INFO:tasks.workunit.client.0.smithi139.stderr:If you want to create a new branch to retain commits you create, you may 2020-02-12T14:14:40.978 INFO:tasks.workunit.client.0.smithi139.stderr:do so (now or later) by using -b with the checkout command again. Example: 2020-02-12T14:14:40.978 INFO:tasks.workunit.client.0.smithi139.stderr: 2020-02-12T14:14:40.978 INFO:tasks.workunit.client.0.smithi139.stderr: git checkout -b 2020-02-12T14:14:40.979 INFO:tasks.workunit.client.0.smithi139.stderr: 2020-02-12T14:14:40.979 INFO:tasks.workunit.client.0.smithi139.stderr:HEAD is now at 7df2194963 Merge PR #33194 into wip-pdonnell-testing-20200211.222321 2020-02-12T14:14:40.982 INFO:teuthology.orchestra.run.smithi139:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2020-02-12T14:14:41.013 INFO:tasks.workunit.client.0.smithi139.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2020-02-12T14:14:41.015 INFO:tasks.workunit.client.0.smithi139.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-02-12T14:14:41.016 INFO:tasks.workunit.client.0.smithi139.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2020-02-12T14:14:41.634 INFO:tasks.workunit.client.0.smithi139.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2020-02-12T14:14:41.687 INFO:tasks.workunit.client.0.smithi139.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2020-02-12T14:14:41.725 INFO:tasks.workunit.client.0.smithi139.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-02-12T14:14:41.726 INFO:tasks.workunit.client.0.smithi139.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-02-12T14:14:41.727 INFO:tasks.workunit.client.0.smithi139.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2020-02-12T14:14:41.763 INFO:tasks.workunit.client.0.smithi139.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-02-12T14:14:41.823 DEBUG:teuthology.orchestra.remote:smithi139:/home/ubuntu/cephtest/workunits.list.client.0 is 4KB 2020-02-12T14:14:41.841 INFO:tasks.workunit:Running workunits matching suites/pjd.sh on client.0... 2020-02-12T14:14:41.842 INFO:tasks.workunit:Running workunit suites/pjd.sh... 2020-02-12T14:14:41.842 INFO:teuthology.orchestra.run.smithi139:workunit test suites/pjd.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7df2194963eaa185d198b9c90e899c7e7ae9eb30 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/pjd.sh 2020-02-12T14:14:44.406 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~63s 2020-02-12T14:14:44.407 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~95s 2020-02-12T14:14:50.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~69s 2020-02-12T14:14:50.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~101s 2020-02-12T14:14:57.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~76s 2020-02-12T14:14:57.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~108s 2020-02-12T14:15:03.346 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~82s 2020-02-12T14:15:03.347 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~114s 2020-02-12T14:15:09.659 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~88s 2020-02-12T14:15:09.659 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~120s 2020-02-12T14:15:10.871 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:15:10.874 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:15:15.971 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~95s 2020-02-12T14:15:15.971 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~127s 2020-02-12T14:15:22.282 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~101s 2020-02-12T14:15:22.283 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~133s 2020-02-12T14:15:28.594 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~107s 2020-02-12T14:15:28.594 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~139s 2020-02-12T14:15:34.906 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~114s 2020-02-12T14:15:34.906 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~146s 2020-02-12T14:15:41.218 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:15:41.219 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~120s 2020-02-12T14:15:41.219 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~152s 2020-02-12T14:15:41.221 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:15:47.530 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~126s 2020-02-12T14:15:47.530 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~158s 2020-02-12T14:15:48.047 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:15:48.045+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:15:53.048 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:15:53.046+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:15:53.842 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~133s 2020-02-12T14:15:53.842 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~165s 2020-02-12T14:15:58.048 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:15:58.047+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:16:00.154 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~139s 2020-02-12T14:16:00.154 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~171s 2020-02-12T14:16:03.049 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:16:03.047+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 59 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:16:06.468 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~145s 2020-02-12T14:16:06.468 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~177s 2020-02-12T14:16:08.050 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:16:08.048+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 79 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:16:11.287 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:16:11.290 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:16:12.781 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~151s 2020-02-12T14:16:12.781 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~184s 2020-02-12T14:16:13.050 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:16:13.049+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 96 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:16:18.051 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:16:18.050+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 118 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:16:19.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~158s 2020-02-12T14:16:19.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~190s 2020-02-12T14:16:23.052 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:16:23.050+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 135 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:16:25.402 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~164s 2020-02-12T14:16:25.403 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~196s 2020-02-12T14:16:28.052 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:16:28.051+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 155 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:16:31.716 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~170s 2020-02-12T14:16:31.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~202s 2020-02-12T14:16:33.053 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:16:33.050+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 172 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:16:38.028 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~177s 2020-02-12T14:16:38.029 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~209s 2020-02-12T14:16:38.054 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:16:38.051+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 194 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:16:41.374 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:16:41.377 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:16:43.054 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:16:43.052+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 211 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:16:44.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~183s 2020-02-12T14:16:44.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~215s 2020-02-12T14:16:48.056 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:16:48.053+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 231 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:16:50.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~189s 2020-02-12T14:16:50.652 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~221s 2020-02-12T14:16:53.055 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:16:53.053+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 248 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:16:56.964 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~196s 2020-02-12T14:16:56.964 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~228s 2020-02-12T14:16:58.056 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:16:58.055+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 268 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:17:03.057 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:17:03.055+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 287 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:17:03.276 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~202s 2020-02-12T14:17:03.276 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~234s 2020-02-12T14:17:08.058 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:17:08.056+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 305 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:17:09.590 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~208s 2020-02-12T14:17:09.590 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~240s 2020-02-12T14:17:11.446 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:17:11.449 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:17:13.058 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:17:13.057+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 324 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:17:15.903 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~215s 2020-02-12T14:17:15.903 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~247s 2020-02-12T14:17:18.058 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:17:18.057+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 344 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:17:22.216 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~221s 2020-02-12T14:17:22.216 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~253s 2020-02-12T14:17:23.060 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:17:23.057+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 363 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:17:28.060 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:17:28.058+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 381 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:17:28.524 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~227s 2020-02-12T14:17:28.524 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~259s 2020-02-12T14:17:33.061 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:17:33.058+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 400 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:17:34.835 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~234s 2020-02-12T14:17:34.835 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~266s 2020-02-12T14:17:38.061 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:17:38.059+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 420 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:17:41.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~240s 2020-02-12T14:17:41.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~272s 2020-02-12T14:17:41.510 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:17:41.513 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:17:43.062 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:17:43.060+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 439 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:17:47.456 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~246s 2020-02-12T14:17:47.457 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~278s 2020-02-12T14:17:48.063 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:17:48.061+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 457 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:17:53.063 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:17:53.062+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 476 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:17:53.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~252s 2020-02-12T14:17:53.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~285s 2020-02-12T14:17:58.064 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:17:58.063+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 496 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:18:00.078 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~259s 2020-02-12T14:18:00.078 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~291s 2020-02-12T14:18:03.064 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:18:03.063+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 515 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:18:06.394 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~265s 2020-02-12T14:18:06.394 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~297s 2020-02-12T14:18:08.066 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:18:08.063+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 533 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:18:11.582 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:18:11.584 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:18:12.708 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~271s 2020-02-12T14:18:12.708 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~303s 2020-02-12T14:18:12.708 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2020-02-12T14:18:12.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-12T14:18:12.709 INFO:teuthology.orchestra.run.smithi139:> stat --file-system '--printf=%T 2020-02-12T14:18:12.709 INFO:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0 2020-02-12T14:18:13.066 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:18:13.064+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 552 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:18:18.066 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:18:18.065+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 572 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:18:23.068 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:18:23.065+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 591 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:18:28.068 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:18:28.066+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 609 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:18:33.068 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:18:33.067+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 628 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:18:38.069 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:18:38.068+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 648 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:18:41.652 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:18:41.655 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:18:43.070 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:18:43.069+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 667 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:18:48.071 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:18:48.070+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 685 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:18:53.071 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:18:53.070+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 704 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:18:58.072 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:18:58.070+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 724 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:19:03.074 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:19:03.071+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 743 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:19:08.074 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:19:08.071+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 761 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:19:11.740 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:19:11.743 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:19:13.075 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:19:13.072+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 780 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:19:18.075 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:19:18.073+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 800 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:19:23.076 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:19:23.075+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 819 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:19:28.076 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:19:28.075+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 837 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:19:33.077 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:19:33.076+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 856 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:19:38.078 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:19:38.077+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 876 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:19:41.802 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:19:41.805 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:19:43.079 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:19:43.077+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 894 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:19:48.080 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:19:48.078+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 913 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:19:53.082 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:19:53.079+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 930 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:19:58.082 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:19:58.080+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 952 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:20:03.083 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:20:03.081+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 969 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:20:08.084 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:20:08.082+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 989 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:20:11.882 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:20:11.885 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:20:13.085 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:20:13.084+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1008 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:20:18.085 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:20:18.084+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1031 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:20:23.086 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:20:23.085+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1049 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:20:28.087 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:20:28.086+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1070 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:20:33.088 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:20:33.086+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1088 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:20:38.089 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:20:38.087+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1111 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:20:41.953 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:20:41.956 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:20:43.090 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:20:43.088+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1129 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:20:48.090 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:20:48.088+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1150 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:20:53.091 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:20:53.089+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1168 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:20:58.092 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:20:58.091+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1191 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:21:03.093 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:21:03.092+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1209 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:21:08.094 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:21:08.093+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1230 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:21:12.032 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:21:12.035 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:21:13.095 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:21:13.094+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1248 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:21:18.095 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:21:18.093+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1271 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:21:23.096 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:21:23.094+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1289 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:21:28.098 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:21:28.095+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1310 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:21:33.098 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:21:33.096+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1328 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:21:38.098 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:21:38.096+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1351 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:21:42.095 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:21:42.098 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:21:43.099 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:21:43.098+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1369 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:21:48.100 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:21:48.099+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1390 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:21:53.101 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:21:53.100+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1408 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:21:58.102 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:21:58.101+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1431 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:22:03.103 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:22:03.100+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1449 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:22:08.103 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:22:08.101+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1470 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:22:12.174 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:22:12.177 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:22:13.104 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:22:13.102+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1488 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:22:18.105 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:22:18.103+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1511 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:22:23.106 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:22:23.104+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1529 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:22:28.107 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:22:28.105+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1550 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:22:33.107 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:22:33.106+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1568 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:22:38.108 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:22:38.107+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1590 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:22:42.246 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:22:42.249 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:22:43.109 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:22:43.108+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1609 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:22:48.110 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:22:48.109+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1628 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:22:53.111 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:22:53.109+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1648 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:22:58.111 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:22:58.109+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1669 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:23:03.112 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:23:03.110+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1689 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:23:08.114 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:23:08.111+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1708 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:23:12.314 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:23:12.317 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:23:13.114 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:23:13.112+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1728 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:23:18.114 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:23:18.113+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1749 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:23:23.115 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:23:23.114+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1769 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:23:28.117 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:23:28.115+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1788 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:23:33.117 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:23:33.116+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1808 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:23:38.118 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:23:38.116+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1829 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:23:42.376 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:23:42.379 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:23:43.119 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:23:43.117+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1849 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:23:48.119 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:23:48.117+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1868 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:23:53.121 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:23:53.118+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1888 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:23:58.121 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:23:58.119+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1909 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:24:03.122 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:24:03.120+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1929 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:24:08.123 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:24:08.122+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1948 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:24:12.458 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:24:12.461 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:24:13.124 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:24:13.122+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1968 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:24:18.126 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:24:18.123+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1989 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:24:23.126 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:24:23.124+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2009 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:24:28.126 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:24:28.124+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2028 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:24:33.127 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:24:33.125+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2048 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:24:38.128 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:24:38.126+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2069 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:24:42.539 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:24:42.542 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:24:43.129 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:24:43.127+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2089 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:24:48.130 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:24:48.128+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2108 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:24:53.131 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:24:53.130+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2128 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:24:58.132 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:24:58.131+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2149 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:25:03.133 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:25:03.131+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2169 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:25:08.143 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:25:08.132+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2188 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:25:12.626 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:25:12.629 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:25:13.135 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:25:13.132+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2208 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:25:18.136 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:25:18.133+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2229 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:25:23.136 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:25:23.134+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2249 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:25:28.138 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:25:28.135+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2268 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:25:33.138 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:25:33.136+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2286 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:25:38.139 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:25:38.137+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2309 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:25:42.711 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:25:42.714 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:25:43.140 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:25:43.139+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2327 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:25:48.141 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:25:48.140+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2348 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:25:53.143 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:25:53.141+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2366 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:25:58.143 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:25:58.142+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2389 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:26:03.144 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:26:03.142+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2407 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:26:08.145 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:26:08.143+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2428 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:26:12.794 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:26:12.797 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:26:13.146 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:26:13.144+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2446 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:26:18.147 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:26:18.145+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2469 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:26:23.148 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:26:23.146+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2487 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:26:28.149 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:26:28.148+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2508 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:26:33.150 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:26:33.149+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2526 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:26:38.151 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:26:38.150+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2549 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:26:42.860 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:26:42.863 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:26:43.152 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:26:43.151+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2567 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:26:48.153 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:26:48.151+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2588 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:26:53.154 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:26:53.151+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2606 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:26:58.158 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:26:58.152+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2629 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:27:03.156 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:27:03.153+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2647 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:27:08.156 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:27:08.154+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2668 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:27:12.923 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:27:12.926 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:27:13.158 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:27:13.155+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2686 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:27:18.158 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:27:18.157+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2709 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:27:23.159 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:27:23.158+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2727 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:27:28.161 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:27:28.159+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2748 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:27:33.162 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:27:33.160+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2766 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:27:38.162 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:27:38.160+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2789 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:27:43.000 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:27:43.002 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:27:43.166 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:27:43.161+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2807 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:27:48.164 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:27:48.162+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2828 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:27:53.166 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:27:53.163+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2846 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:27:58.166 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:27:58.164+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2869 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:28:03.167 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:28:03.166+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2887 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:28:08.168 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:28:08.167+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2908 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:28:13.069 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:28:13.072 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:28:13.169 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:28:13.168+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2926 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:28:18.170 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:28:18.169+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2948 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:28:23.171 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:28:23.169+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2967 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:28:28.172 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:28:28.170+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2986 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:28:33.174 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:28:33.172+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3006 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:28:38.175 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:28:38.173+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3027 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:28:43.134 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:28:43.137 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:28:43.176 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:28:43.174+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3047 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:28:48.176 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:28:48.175+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3066 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:28:53.178 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:28:53.177+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:28:58.179 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:28:58.178+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3107 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:29:03.180 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:29:03.179+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3127 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:29:08.181 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:29:08.180+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3146 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:29:13.182 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:29:13.180+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3166 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:29:13.214 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:29:13.217 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:29:18.183 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:29:18.181+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3187 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:29:23.184 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:29:23.181+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3207 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:29:28.184 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:29:28.182+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3226 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:29:33.185 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:29:33.183+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3246 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:29:38.187 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:29:38.185+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3267 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:29:43.188 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:29:43.186+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3287 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:29:43.294 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:29:43.297 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:29:48.188 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:29:48.187+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3306 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:29:53.190 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:29:53.188+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3326 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:29:58.191 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:29:58.188+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3347 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:30:03.191 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:30:03.189+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3367 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:30:08.192 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:30:08.190+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3386 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:30:13.193 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:30:13.191+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3406 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:30:13.373 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:30:13.376 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:30:18.195 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:30:18.192+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3427 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:30:23.195 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:30:23.194+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3447 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:30:28.197 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:30:28.195+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3466 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:30:33.198 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:30:33.197+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3486 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:30:38.199 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:30:38.198+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3507 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:30:43.200 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:30:43.199+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3527 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:30:43.444 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:30:43.448 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:30:48.200 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:30:48.199+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3546 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:30:53.202 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:30:53.200+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3566 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:30:58.203 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:30:58.201+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3587 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:31:03.205 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:31:03.202+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3607 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:31:08.205 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:31:08.203+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3626 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:31:13.207 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:31:13.205+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3645 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:31:13.526 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:31:13.529 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:31:18.208 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:31:18.206+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3667 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:31:23.209 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:31:23.208+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3685 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:31:28.210 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:31:28.209+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3706 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:31:33.211 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:31:33.209+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3724 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:31:38.212 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:31:38.210+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3747 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:31:43.213 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:31:43.211+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3765 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:31:43.589 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:31:43.592 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:31:48.215 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:31:48.212+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3786 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:31:53.216 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:31:53.213+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3804 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:31:58.217 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:31:58.215+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3827 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:32:03.218 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:32:03.217+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3845 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:32:08.219 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:32:08.218+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3866 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:32:13.220 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:32:13.219+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3884 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:32:13.659 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:32:13.662 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:32:18.221 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:32:18.220+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3907 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:32:23.222 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:32:23.220+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3925 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:32:28.223 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:32:28.221+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3946 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:32:33.224 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:32:33.222+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3964 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:32:38.225 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:32:38.223+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3987 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:32:43.226 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:32:43.224+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4005 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:32:43.731 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:32:43.734 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:32:48.227 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:32:48.226+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4026 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:32:53.229 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:32:53.228+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4044 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:32:58.230 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:32:58.229+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4067 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:33:03.231 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:33:03.230+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4085 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:33:08.232 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:33:08.230+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4106 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:33:12.714 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 303, in copy_file_to copy_to_log(src, logger, capture=stream) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 272, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/file.py", line 108, in next line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() timeout 2020-02-12T14:33:12.720 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 303, in copy_file_to copy_to_log(src, logger, capture=stream) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 272, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/file.py", line 108, in next line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() timeout 2020-02-12T14:33:13.233 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:33:13.231+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4124 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:33:13.802 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:33:13.805 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:33:18.234 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:33:18.232+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4147 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:33:23.235 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:33:23.233+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4165 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:33:28.236 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:33:28.234+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4186 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:33:33.238 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:33:33.235+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4204 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:33:38.238 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:33:38.237+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4227 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:33:43.240 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:33:43.238+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4245 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:33:43.874 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:33:43.876 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:33:48.241 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:33:48.240+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4266 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:33:53.242 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:33:53.241+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4284 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:33:58.243 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:33:58.241+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4307 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:34:03.244 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:34:03.242+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4325 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:34:08.245 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:34:08.243+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4345 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:34:13.246 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:34:13.244+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4364 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:34:13.937 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:34:13.940 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:34:18.248 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:34:18.246+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4385 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:34:23.249 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:34:23.248+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4405 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:34:28.250 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:34:28.249+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4424 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:34:33.251 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:34:33.250+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4444 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:34:38.252 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:34:38.251+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4465 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:34:43.254 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:34:43.252+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4485 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:34:44.001 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:34:44.003 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:34:48.255 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:34:48.253+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4504 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:34:53.256 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:34:53.254+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4524 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:34:58.258 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:34:58.255+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4545 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:35:03.259 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:35:03.257+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4565 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:35:08.260 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:35:08.258+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4584 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:35:13.261 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:35:13.260+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4604 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:35:14.091 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:35:14.094 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:35:18.262 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:35:18.261+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4625 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:35:23.263 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:35:23.262+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4645 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:35:28.265 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:35:28.263+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4664 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:35:33.266 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:35:33.264+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4684 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:35:38.267 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:35:38.265+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4705 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:35:43.268 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:35:43.266+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4725 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:35:44.168 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:35:44.171 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:35:48.269 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:35:48.267+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4744 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:35:53.270 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:35:53.268+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4764 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:35:58.271 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:35:58.271+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4785 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:36:03.273 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:36:03.272+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4805 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:36:08.274 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:36:08.273+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4824 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:36:13.275 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:36:13.274+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4844 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:36:14.239 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:36:14.242 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:36:18.277 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:36:18.275+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4865 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:36:23.278 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:36:23.276+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4885 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:36:28.279 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:36:28.277+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4904 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:36:33.281 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:36:33.279+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4924 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:36:38.282 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:36:38.280+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4945 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:36:43.283 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:36:43.281+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4965 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:36:44.319 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:36:44.322 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:36:48.284 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:36:48.283+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4984 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:36:53.286 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:36:53.285+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5004 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:36:58.287 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:36:58.286+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5025 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:37:03.289 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:37:03.287+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5044 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:37:08.289 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:37:08.287+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5064 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:37:13.291 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:37:13.289+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5082 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:37:14.382 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:37:14.384 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:37:18.293 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:37:18.290+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5105 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:37:23.293 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:37:23.291+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5123 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:37:28.294 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:37:28.292+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5144 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:37:33.296 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:37:33.295+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5162 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:37:38.297 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:37:38.296+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5185 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:37:43.298 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:37:43.297+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5203 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:37:44.477 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:37:44.480 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:37:48.299 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:37:48.298+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5224 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:37:53.300 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:37:53.299+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5242 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:37:58.302 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:37:58.300+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5265 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:38:03.303 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:38:03.301+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5283 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:38:08.304 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:38:08.303+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5304 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:38:13.306 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:38:13.304+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5322 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:38:14.553 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:38:14.556 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:38:18.310 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:38:18.305+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5345 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:38:23.309 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:38:23.308+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5363 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:38:28.310 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:38:28.309+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5384 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:38:33.311 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:38:33.310+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5402 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:38:38.313 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:38:38.312+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5425 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:38:43.314 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:38:43.312+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5443 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:38:44.613 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:38:44.616 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:38:48.315 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:38:48.313+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5464 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:38:53.316 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:38:53.314+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5482 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:38:58.318 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:38:58.316+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5505 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:39:03.319 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:39:03.317+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5523 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:39:08.321 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:39:08.319+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5544 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:39:13.322 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:39:13.320+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5562 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:39:14.677 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:39:14.680 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:39:18.323 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:39:18.322+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5585 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:39:23.324 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:39:23.323+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5603 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:39:28.326 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:39:28.323+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5624 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:39:33.327 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:39:33.325+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5642 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:39:38.328 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:39:38.326+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5665 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:39:43.329 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:39:43.327+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5683 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:39:44.747 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:39:44.750 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:39:48.331 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:39:48.329+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5704 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:39:53.332 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:39:53.331+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5722 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:39:58.334 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:39:58.333+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5744 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:40:03.335 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:40:03.334+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5763 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:40:08.336 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:40:08.335+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5782 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:40:13.338 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:40:13.336+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5802 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:40:14.812 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:40:14.814 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:40:18.339 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:40:18.337+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5823 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:40:23.340 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:40:23.338+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5843 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:40:28.342 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:40:28.340+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5862 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:40:33.343 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:40:33.341+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5882 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:40:38.344 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:40:38.343+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5903 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:40:43.346 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:40:43.345+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5923 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:40:44.899 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:40:44.902 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:40:48.347 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:40:48.347+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5943 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:40:53.349 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:40:53.348+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5963 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:40:58.350 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:40:58.349+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5985 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:41:03.352 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:41:03.350+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6005 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:41:08.353 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:41:08.351+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6025 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:41:13.355 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:41:13.352+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6045 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:41:14.981 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:41:14.984 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:41:18.356 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:41:18.354+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6067 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:41:23.357 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:41:23.355+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6087 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:41:28.359 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:41:28.358+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6107 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:41:33.360 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:41:33.359+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6127 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:41:38.362 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:41:38.361+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6149 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:41:43.363 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:41:43.362+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6169 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:41:45.046 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:41:45.049 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:41:48.365 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:41:48.363+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6189 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:41:53.366 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:41:53.364+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6209 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:41:58.367 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:41:58.365+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6231 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:42:03.369 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:42:03.367+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6251 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:42:08.370 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:42:08.369+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6271 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:42:13.372 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:42:13.370+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6291 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:42:15.113 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:42:15.116 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:42:18.374 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:42:18.372+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6313 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:42:23.378 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:42:23.374+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6333 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:42:28.376 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:42:28.375+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6353 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:42:33.377 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:42:33.377+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6373 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:42:38.379 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:42:38.377+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6395 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:42:43.380 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:42:43.378+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6415 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:42:45.185 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:42:45.188 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:42:48.382 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:42:48.380+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6435 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:42:53.383 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:42:53.381+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6454 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:42:58.385 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:42:58.383+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6477 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:43:03.386 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:43:03.385+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6495 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:43:08.388 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:43:08.387+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6517 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:43:13.389 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:43:13.388+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6535 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:43:15.257 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:43:15.260 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:43:18.395 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:43:18.390+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6559 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:43:23.392 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:43:23.390+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6577 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:43:28.394 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:43:28.392+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6599 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:43:33.395 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:43:33.393+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6617 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:43:38.397 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:43:38.395+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6641 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:43:43.398 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:43:43.396+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6659 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:43:45.342 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:43:45.345 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:43:48.399 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:43:48.397+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6681 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:43:53.401 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:43:53.400+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6699 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:43:58.402 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:43:58.401+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6723 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:44:03.403 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:44:03.403+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6741 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:44:08.405 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:44:08.404+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6763 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:44:13.406 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:44:13.404+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6781 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:44:15.419 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:44:15.422 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:44:18.408 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:44:18.406+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6805 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:44:23.409 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:44:23.407+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6823 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:44:28.410 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:44:28.409+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6845 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:44:33.412 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:44:33.410+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6863 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:44:38.414 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:44:38.413+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6887 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:44:43.415 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:44:43.414+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6905 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:44:45.487 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:44:45.490 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:44:48.417 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:44:48.416+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6927 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:44:53.418 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:44:53.417+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6945 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:44:58.420 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:44:58.418+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6969 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:45:03.421 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:45:03.419+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6987 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:45:08.422 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:45:08.421+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7009 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:45:13.424 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:45:13.422+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7027 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:45:15.549 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:45:15.551 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:45:18.426 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:45:18.424+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7051 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:45:23.427 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:45:23.425+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7069 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:45:28.429 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:45:28.428+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7091 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:45:33.430 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:45:33.429+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7109 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:45:38.432 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:45:38.431+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7133 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:45:43.433 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:45:43.432+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7151 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:45:45.621 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:45:45.625 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:45:48.435 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:45:48.433+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7172 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:45:53.436 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:45:53.434+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7191 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:45:58.438 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:45:58.436+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7213 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:46:03.439 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:46:03.437+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7233 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:46:08.441 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:46:08.439+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7253 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:46:13.442 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:46:13.441+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7273 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:46:15.686 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:46:15.689 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:46:18.444 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:46:18.443+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7295 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:46:23.445 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:46:23.444+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7315 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:46:28.447 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:46:28.446+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7335 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:46:33.448 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:46:33.446+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7355 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:46:38.450 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:46:38.448+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7377 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:46:43.451 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:46:43.449+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7397 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:46:45.767 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:46:45.770 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:46:48.453 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:46:48.451+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7417 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:46:53.455 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:46:53.453+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7437 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:46:58.456 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:46:58.454+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7459 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:47:03.460 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:47:03.457+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7479 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:47:08.459 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:47:08.458+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7499 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:47:13.461 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:47:13.460+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7519 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:47:15.840 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:47:15.843 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:47:18.462 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:47:18.461+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7541 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:47:23.464 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:47:23.462+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7561 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:47:28.465 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:47:28.463+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7581 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:47:33.467 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:47:33.465+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7601 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:47:38.469 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:47:38.466+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7623 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:47:43.470 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:47:43.468+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7643 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:47:45.905 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:47:45.908 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:47:48.471 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:47:48.470+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7663 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:47:53.473 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:47:53.472+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7683 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:47:58.474 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:47:58.473+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7705 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:48:03.476 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:48:03.475+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7725 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:48:08.478 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:48:08.475+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7745 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:48:13.479 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:48:13.477+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7765 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:48:15.978 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:48:15.981 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:48:18.481 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:48:18.479+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7787 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:48:23.482 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:48:23.480+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7807 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:48:28.484 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:48:28.482+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7827 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:48:33.485 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:48:33.483+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7847 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:48:38.487 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:48:38.486+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7869 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:48:43.489 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:48:43.487+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7889 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:48:46.041 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:48:46.044 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:48:48.490 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:48:48.489+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7909 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:48:53.492 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:48:53.491+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7927 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:48:58.494 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:48:58.491+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7951 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:49:03.495 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:49:03.493+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7969 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:49:08.497 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:49:08.495+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7991 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:49:13.499 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:49:13.496+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8009 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:49:16.104 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:49:16.107 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:49:18.500 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:49:18.498+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8033 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:49:23.502 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:49:23.501+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8051 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:49:28.504 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:49:28.502+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8073 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:49:33.506 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:49:33.504+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8091 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:49:38.507 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:49:38.506+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8115 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:49:43.509 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:49:43.507+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8133 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:49:46.172 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:49:46.175 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:49:48.511 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:49:48.508+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8155 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:49:53.512 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:49:53.510+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8173 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:49:58.514 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:49:58.512+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8197 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:50:03.515 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:50:03.513+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8215 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:50:08.517 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:50:08.515+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8237 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:50:13.519 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:50:13.517+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8255 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:50:16.249 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:50:16.252 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:50:18.521 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:50:18.519+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8279 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:50:23.522 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:50:23.521+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8297 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:50:28.524 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:50:28.523+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8319 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:50:33.525 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:50:33.523+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8337 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:50:38.527 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:50:38.525+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8361 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:50:43.529 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:50:43.527+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8379 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:50:46.327 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:50:46.329 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:50:48.531 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:50:48.528+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8401 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:50:53.533 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:50:53.530+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8419 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:50:58.535 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:50:58.533+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8443 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:51:03.536 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:51:03.535+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8461 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:51:08.538 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:51:08.537+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8483 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:51:13.540 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:51:13.538+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8501 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:51:16.391 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:51:16.394 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:51:18.542 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:51:18.539+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8525 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:51:23.543 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:51:23.541+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8543 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:51:28.545 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:51:28.543+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8565 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:51:33.547 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:51:33.545+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8583 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:51:38.549 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:51:38.547+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8607 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:51:43.551 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:51:43.548+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8625 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:51:46.478 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:51:46.480 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:51:48.552 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:51:48.551+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8645 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:51:53.554 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:51:53.553+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8665 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:51:58.556 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:51:58.555+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8687 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:52:03.558 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:52:03.557+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8707 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:52:08.560 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:52:08.557+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8727 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:52:13.561 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:52:13.559+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8747 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:52:16.546 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:52:16.549 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:52:18.564 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:52:18.561+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8769 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:52:23.565 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:52:23.563+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8789 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:52:28.567 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:52:28.565+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8809 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:52:33.569 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:52:33.567+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8829 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:52:38.570 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:52:38.569+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8851 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:52:43.572 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:52:43.571+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8871 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:52:46.614 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:52:46.618 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:52:48.574 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:52:48.573+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8891 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:52:53.576 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:52:53.573+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8911 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:52:58.578 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:52:58.575+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8933 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:53:03.579 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:53:03.577+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8953 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:53:08.581 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:53:08.578+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8973 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:53:13.582 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:53:13.580+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8993 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:53:16.684 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:53:16.687 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:53:18.584 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:53:18.582+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9015 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:53:23.586 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:53:23.584+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9035 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:53:28.587 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:53:28.586+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9055 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:53:33.589 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:53:33.588+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9075 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:53:38.591 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:53:38.590+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9097 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:53:43.593 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:53:43.590+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9117 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:53:46.781 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:53:46.784 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:53:48.595 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:53:48.592+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9137 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:53:53.596 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:53:53.594+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9157 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:53:58.598 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:53:58.596+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9179 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:54:03.600 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:54:03.598+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9199 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:54:08.602 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:54:08.600+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9219 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:54:13.604 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:54:13.602+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9239 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:54:16.852 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:54:16.855 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:54:18.606 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:54:18.604+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9261 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:54:23.607 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:54:23.606+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9281 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:54:28.609 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:54:28.607+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9301 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:54:33.611 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:54:33.609+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9321 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:54:38.613 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:54:38.611+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9343 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:54:43.615 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:54:43.612+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9362 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:54:46.918 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:54:46.921 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:54:48.617 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:54:48.614+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9383 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:54:53.619 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:54:53.617+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9401 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:54:58.629 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:54:58.619+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9425 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:55:03.622 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:55:03.621+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9443 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:55:08.624 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:55:08.623+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9465 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:55:13.626 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:55:13.623+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9483 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:55:16.987 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:55:16.989 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:55:18.628 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:55:18.625+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9507 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:55:23.630 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:55:23.627+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9525 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:55:28.632 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:55:28.629+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9547 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:55:33.634 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:55:33.631+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9565 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:55:38.635 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:55:38.633+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9589 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:55:43.637 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:55:43.635+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9607 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:55:47.063 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:55:47.066 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:55:48.639 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:55:48.637+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9629 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:55:53.640 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:55:53.639+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9647 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:55:58.642 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:55:58.640+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9671 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:56:03.644 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:56:03.641+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9689 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:56:08.646 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:56:08.643+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9711 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:56:13.647 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:56:13.645+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9729 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:56:17.155 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:56:17.157 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:56:18.650 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:56:18.647+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9753 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:56:23.651 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:56:23.650+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9771 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:56:28.654 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:56:28.652+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9793 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:56:33.655 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:56:33.654+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9811 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:56:38.657 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:56:38.656+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9835 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:56:43.659 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:56:43.657+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9853 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:56:47.242 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:56:47.245 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:56:48.660 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:56:48.658+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9875 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:56:53.662 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:56:53.659+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9893 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:56:58.664 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:56:58.661+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9917 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:57:03.666 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:57:03.663+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9935 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:57:08.668 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:57:08.665+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9957 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:57:13.670 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:57:13.668+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9975 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:57:17.306 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:57:17.309 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:57:18.672 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:57:18.670+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9999 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:57:23.674 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:57:23.672+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10017 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:57:28.675 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:57:28.673+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10039 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:57:33.677 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:57:33.674+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10057 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:57:38.679 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:57:38.676+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10080 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:57:43.681 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:57:43.678+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10099 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:57:47.378 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:57:47.386 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:57:48.683 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:57:48.680+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10119 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:57:53.685 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:57:53.682+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10139 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:57:58.687 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:57:58.685+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10161 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:58:03.689 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:58:03.687+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10181 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:58:08.691 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:58:08.689+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10201 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:58:13.693 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:58:13.691+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10221 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:58:17.461 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:58:17.464 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:58:18.695 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:58:18.692+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10243 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:58:23.697 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:58:23.694+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10263 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:58:28.699 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:58:28.696+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10283 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:58:33.701 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:58:33.698+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10303 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:58:38.703 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:58:38.700+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10325 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:58:43.705 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:58:43.703+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10345 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:58:47.533 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:58:47.535 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:58:48.707 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:58:48.705+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10365 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:58:53.709 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:58:53.707+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10385 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:58:58.711 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:58:58.709+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10407 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:59:03.712 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:59:03.710+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10427 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:59:08.714 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:59:08.711+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10447 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:59:13.716 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:59:13.713+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10467 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:59:17.613 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:59:17.616 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:59:18.718 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:59:18.715+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10489 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:59:23.720 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:59:23.717+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10509 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:59:28.722 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:59:28.719+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10529 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:59:33.724 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:59:33.722+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10549 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:59:38.726 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:59:38.724+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10571 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:59:43.728 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:59:43.726+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10591 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:59:47.694 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:59:47.697 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T14:59:48.730 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:59:48.728+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10611 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:59:53.732 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:59:53.729+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10631 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T14:59:58.734 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T14:59:58.731+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10653 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:00:03.736 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:00:03.733+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10673 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:00:08.738 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:00:08.735+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10693 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:00:13.740 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:00:13.737+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10713 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:00:17.784 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:00:17.787 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:00:18.742 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:00:18.739+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10735 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:00:23.744 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:00:23.742+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10755 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:00:28.746 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:00:28.744+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10775 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:00:33.748 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:00:33.746+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10795 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:00:38.749 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:00:38.748+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10817 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:00:43.751 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:00:43.748+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10835 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:00:47.852 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:00:47.856 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:00:48.753 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:00:48.750+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10857 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:00:53.755 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:00:53.752+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10875 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:00:58.757 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:00:58.754+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10899 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:01:03.759 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:01:03.756+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10917 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:01:08.761 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:01:08.759+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10939 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:01:13.763 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:01:13.761+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10957 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:01:17.938 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:01:17.940 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:01:18.765 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:01:18.763+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10981 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:01:23.767 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:01:23.765+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10999 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:01:28.776 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:01:28.766+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11021 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:01:33.771 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:01:33.768+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11039 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:01:38.773 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:01:38.770+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11063 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:01:43.775 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:01:43.772+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11081 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:01:48.023 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:01:48.026 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:01:48.777 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:01:48.774+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11103 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:01:53.779 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:01:53.776+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11121 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:01:58.781 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:01:58.779+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11145 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:02:03.783 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:02:03.781+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11163 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:02:08.785 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:02:08.783+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11185 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:02:13.787 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:02:13.785+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11204 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:02:18.110 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:02:18.113 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:02:18.792 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:02:18.786+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11227 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:02:23.791 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:02:23.788+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11246 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:02:28.794 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:02:28.790+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11267 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:02:33.795 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:02:33.792+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11286 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:02:38.797 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:02:38.794+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11309 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:02:43.799 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:02:43.797+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11328 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:02:48.182 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:02:48.185 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:02:48.801 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:02:48.799+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11349 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:02:53.803 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:02:53.801+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11368 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:02:58.805 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:02:58.803+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11391 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:03:03.807 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:03:03.804+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11410 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:03:08.809 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:03:08.806+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11431 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:03:13.811 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:03:13.808+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11450 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:03:18.256 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:03:18.259 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:03:18.813 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:03:18.810+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11473 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:03:23.815 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:03:23.812+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11492 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:03:28.818 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:03:28.814+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11513 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:03:33.820 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:03:33.818+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11532 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:03:38.821 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:03:38.819+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11554 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:03:43.823 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:03:43.821+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11574 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:03:48.338 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:03:48.340 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:03:48.825 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:03:48.823+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11593 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:03:53.832 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:03:53.824+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11614 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:03:58.832 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:03:58.827+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11635 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:04:03.832 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:04:03.829+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11656 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:04:08.834 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:04:08.831+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11675 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:04:13.836 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:04:13.833+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11696 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:04:18.423 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:04:18.426 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:04:18.838 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:04:18.836+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11717 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:04:23.839 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:04:23.837+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11738 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:04:28.841 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:04:28.839+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11757 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:04:33.843 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:04:33.841+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11778 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:04:38.845 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:04:38.842+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11799 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:04:43.847 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:04:43.845+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11820 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:04:48.500 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:04:48.503 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:04:48.849 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:04:48.846+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11839 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:04:53.852 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:04:53.849+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11860 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:04:58.853 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:04:58.850+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11881 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:05:03.856 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:05:03.854+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11902 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:05:08.858 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:05:08.856+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11921 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:05:13.860 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:05:13.858+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11942 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:05:18.586 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:05:18.589 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:05:18.862 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:05:18.860+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11963 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:05:23.864 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:05:23.862+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11984 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:05:28.866 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:05:28.863+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12003 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:05:33.868 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:05:33.865+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12024 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:05:38.870 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:05:38.867+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12045 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:05:43.872 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:05:43.869+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12066 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:05:48.663 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:05:48.666 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:05:48.874 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:05:48.871+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12085 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:05:53.877 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:05:53.875+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12106 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:05:58.879 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:05:58.877+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12127 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:06:03.881 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:06:03.879+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12148 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:06:08.883 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:06:08.881+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12167 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:06:13.886 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:06:13.883+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12188 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:06:18.761 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:06:18.764 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:06:18.888 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:06:18.885+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12209 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:06:23.890 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:06:23.887+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12230 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:06:28.892 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:06:28.889+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12249 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:06:33.894 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:06:33.891+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12270 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:06:38.896 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:06:38.894+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12291 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:06:43.898 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:06:43.896+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12310 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:06:48.839 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:06:48.842 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:06:48.900 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:06:48.898+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12331 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:06:53.902 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:06:53.900+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12350 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:06:58.905 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:06:58.902+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12373 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:07:03.907 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:07:03.904+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12392 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:07:08.908 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:07:08.905+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12413 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:07:13.911 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:07:13.907+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12432 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:07:18.913 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:07:18.910+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12455 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:07:18.919 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:07:18.922 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:07:23.915 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:07:23.912+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12474 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:07:28.917 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:07:28.915+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12495 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:07:33.919 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:07:33.917+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12514 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:07:38.921 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:07:38.919+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12537 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:07:43.924 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:07:43.922+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12556 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:07:48.926 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:07:48.923+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12577 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:07:48.988 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:07:48.991 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:07:53.928 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:07:53.925+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12596 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:07:58.930 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:07:58.927+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12619 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:08:03.938 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:08:03.929+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12638 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:08:08.935 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:08:08.932+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12659 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:08:13.937 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:08:13.935+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12678 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:08:18.939 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:08:18.937+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12701 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:08:19.082 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:08:19.090 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:08:23.941 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:08:23.939+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12720 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:08:28.943 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:08:28.941+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12741 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:08:33.946 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:08:33.943+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12760 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:08:38.948 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:08:38.945+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12783 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:08:43.950 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:08:43.947+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12801 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:08:48.952 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:08:48.949+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12822 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:08:49.178 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:08:49.181 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:08:53.954 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:08:53.951+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12841 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:08:58.956 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:08:58.953+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12864 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:09:03.958 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:09:03.956+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12883 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:09:08.960 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:09:08.958+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12904 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:09:13.963 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:09:13.960+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12923 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:09:18.965 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:09:18.963+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12946 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:09:19.293 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:09:19.296 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:09:23.967 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:09:23.964+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12965 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:09:28.970 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:09:28.967+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12986 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:09:33.972 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:09:33.969+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13007 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:09:38.974 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:09:38.971+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13027 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:09:43.976 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:09:43.973+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13047 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:09:48.978 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:09:48.976+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13066 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:09:49.407 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:09:49.410 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:09:53.980 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:09:53.978+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13089 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:09:58.983 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:09:58.981+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13108 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:10:03.985 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:10:03.983+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13129 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:10:08.987 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:10:08.984+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13148 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:10:13.990 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:10:13.986+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13171 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:10:18.992 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:10:18.988+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13190 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:10:19.480 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:10:19.483 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:10:23.994 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:10:23.991+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13211 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:10:28.996 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:10:28.993+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13230 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:10:33.998 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:10:33.995+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13253 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:10:39.001 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:10:38.998+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13272 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:10:44.003 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:10:44.001+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13293 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:10:49.005 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:10:49.003+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13312 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:10:49.550 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:10:49.553 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:10:54.007 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:10:54.005+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13335 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:10:59.009 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:10:59.006+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13354 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:11:04.012 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:11:04.008+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13375 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:11:09.014 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:11:09.011+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13394 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:11:14.016 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:11:14.013+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13417 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:11:19.018 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:11:19.015+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13436 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:11:19.622 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:11:19.625 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:11:24.020 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:11:24.018+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13457 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:11:29.023 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:11:29.021+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13476 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:11:34.025 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:11:34.023+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13499 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:11:39.027 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:11:39.025+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13518 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:11:44.030 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:11:44.027+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13539 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:11:49.032 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:11:49.029+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13558 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:11:49.691 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:11:49.694 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:11:54.035 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:11:54.032+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13581 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:11:59.037 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:11:59.034+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13600 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:12:04.040 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:12:04.036+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13621 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:12:09.042 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:12:09.039+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13640 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:12:14.044 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:12:14.042+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13663 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:12:19.046 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:12:19.044+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13682 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:12:19.773 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:12:19.776 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:12:24.048 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:12:24.046+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13703 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:12:29.053 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:12:29.049+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13722 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:12:34.053 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:12:34.050+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13745 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:12:39.055 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:12:39.052+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13764 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:12:44.063 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:12:44.055+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13783 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:12:49.060 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:12:49.057+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13804 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:12:49.837 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:12:49.840 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:12:54.062 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:12:54.059+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13825 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:12:59.065 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:12:59.062+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13846 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:13:04.067 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:13:04.064+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13865 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:13:09.069 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:13:09.067+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13886 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:13:14.071 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:13:14.069+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13907 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:13:19.073 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:13:19.070+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13928 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:13:19.927 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:13:19.930 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:13:24.076 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:13:24.072+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13947 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:13:29.078 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:13:29.075+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13968 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:13:34.080 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:13:34.077+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13989 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:13:39.082 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:13:39.079+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14010 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:13:44.084 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:13:44.082+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14029 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:13:49.087 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:13:49.085+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14050 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:13:50.009 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:13:50.012 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:13:54.089 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:13:54.087+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14071 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:13:59.091 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:13:59.089+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14092 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:14:04.094 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:14:04.091+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14111 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:14:09.096 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:14:09.093+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14132 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:14:14.103 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:14:14.095+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14153 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:14:19.101 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:14:19.097+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14174 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:14:20.082 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:14:20.085 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:14:24.103 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:14:24.100+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14193 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:14:29.105 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:14:29.102+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14214 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:14:34.107 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:14:34.105+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14235 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:14:39.110 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:14:39.107+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14256 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:14:44.112 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:14:44.109+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14275 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:14:49.114 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:14:49.112+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14296 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:14:50.175 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:14:50.179 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:14:54.116 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:14:54.113+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14317 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:14:59.118 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:14:59.115+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14338 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:15:04.121 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:15:04.117+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14357 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:15:09.123 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:15:09.120+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14378 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:15:14.125 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:15:14.122+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14399 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:15:19.129 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:15:19.125+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14420 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:15:20.269 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:15:20.272 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:15:24.130 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:15:24.128+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14439 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:15:29.132 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:15:29.130+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14460 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:15:34.135 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:15:34.133+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14481 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:15:39.137 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:15:39.134+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14501 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:15:44.140 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:15:44.136+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14521 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:15:49.142 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:15:49.139+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14540 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:15:50.343 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:15:50.346 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:15:54.145 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:15:54.141+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14563 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:15:59.147 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:15:59.143+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14582 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:16:04.149 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:16:04.146+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14603 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:16:09.151 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:16:09.149+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14622 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:16:14.153 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:16:14.151+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14645 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:16:19.156 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:16:19.154+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14664 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:16:20.417 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:16:20.420 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:16:24.158 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:16:24.156+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14685 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:16:29.161 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:16:29.158+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14704 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:16:34.163 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:16:34.160+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14727 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:16:39.166 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:16:39.162+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14746 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:16:44.168 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:16:44.165+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14767 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:16:49.171 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:16:49.167+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14786 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:16:50.488 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:16:50.491 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:16:54.173 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:16:54.171+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14809 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:16:59.176 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:16:59.173+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14828 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:17:04.178 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:17:04.175+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14849 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:17:09.180 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:17:09.178+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14868 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:17:14.182 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:17:14.179+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14891 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:17:19.185 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:17:19.181+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14910 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:17:20.561 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:17:20.564 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:17:24.187 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:17:24.184+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14931 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:17:29.189 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:17:29.186+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14950 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:17:34.193 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:17:34.188+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14973 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:17:39.194 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:17:39.191+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14992 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:17:44.197 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:17:44.195+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15013 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:17:49.199 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:17:49.197+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15032 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:17:50.649 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:17:50.652 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:17:54.203 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:17:54.200+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15055 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:17:59.205 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:17:59.203+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15074 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:18:04.208 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:18:04.204+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15095 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:18:09.210 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:18:09.206+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15114 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:18:14.212 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:18:14.209+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15137 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:18:19.214 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:18:19.211+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15156 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:18:20.722 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:18:20.724 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:18:24.217 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:18:24.214+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15177 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:18:29.219 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:18:29.217+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15196 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:18:34.222 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:18:34.219+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15219 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:18:39.224 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:18:39.222+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15238 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:18:44.227 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:18:44.224+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15258 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:18:49.230 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:18:49.226+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15278 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:18:50.813 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:18:50.817 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:18:54.231 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:18:54.228+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15299 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:18:59.234 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:18:59.230+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15320 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:19:04.237 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:19:04.233+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15339 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:19:09.239 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:19:09.235+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15360 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:19:14.241 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:19:14.238+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15381 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:19:19.244 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:19:19.241+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15402 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:19:20.875 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:19:20.879 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:19:24.246 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:19:24.244+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15421 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:19:29.249 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:19:29.247+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15442 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:19:34.251 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:19:34.249+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15463 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:19:39.254 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:19:39.250+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15484 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:19:44.256 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:19:44.253+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15503 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:19:49.259 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:19:49.256+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15524 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:19:50.980 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:19:50.982 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:19:54.261 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:19:54.258+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15545 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:19:59.264 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:19:59.260+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15566 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:20:04.267 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:20:04.264+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15585 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:20:09.270 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:20:09.267+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15606 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:20:14.272 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:20:14.269+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15627 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:20:19.274 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:20:19.272+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15648 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:20:21.054 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:20:21.057 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:20:24.276 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:20:24.273+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15667 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:20:29.279 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:20:29.276+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15688 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:20:34.282 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:20:34.278+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15709 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:20:39.284 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:20:39.281+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15730 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:20:44.286 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:20:44.283+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15749 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:20:49.289 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:20:49.286+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15770 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:20:51.150 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:20:51.152 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:20:54.291 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:20:54.289+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15791 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:20:59.294 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:20:59.291+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15812 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:21:04.296 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:21:04.294+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15831 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:21:09.299 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:21:09.296+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15852 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:21:14.302 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:21:14.298+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15873 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:21:19.304 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:21:19.301+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15894 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:21:21.242 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:21:21.245 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:21:24.307 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:21:24.303+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15913 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:21:29.310 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:21:29.306+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15934 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:21:34.312 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:21:34.309+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15955 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:21:39.315 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:21:39.312+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15976 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:21:44.318 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:21:44.315+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15995 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:21:49.320 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:21:49.318+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16014 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:21:51.315 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:21:51.318 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:21:54.323 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:21:54.320+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16037 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:21:59.325 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:21:59.322+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16056 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:22:04.328 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:22:04.324+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16077 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:22:09.331 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:22:09.327+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16096 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:22:14.334 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:22:14.330+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16119 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:22:19.336 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:22:19.333+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16138 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:22:21.388 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:22:21.390 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:22:24.339 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:22:24.336+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16159 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:22:29.342 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:22:29.339+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16178 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:22:34.344 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:22:34.342+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16201 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:22:39.346 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:22:39.344+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16220 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:22:44.349 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:22:44.345+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16241 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:22:49.351 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:22:49.348+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16260 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:22:51.452 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:22:51.455 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:22:54.354 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:22:54.350+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16283 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:22:59.356 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:22:59.353+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16302 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:23:04.359 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:23:04.355+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16323 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:23:09.361 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:23:09.357+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16342 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:23:14.363 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:23:14.361+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16365 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:23:19.366 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:23:19.363+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16384 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:23:21.524 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:23:21.527 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:23:24.369 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:23:24.366+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16405 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:23:29.371 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:23:29.369+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16424 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:23:34.374 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:23:34.370+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16447 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:23:39.376 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:23:39.373+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16466 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:23:44.379 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:23:44.376+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16487 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:23:49.382 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:23:49.378+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16506 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:23:51.623 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:23:51.626 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:23:54.384 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:23:54.381+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16529 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:23:59.387 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:23:59.385+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16548 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:24:04.389 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:24:04.387+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16569 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:24:09.392 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:24:09.390+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16588 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:24:14.395 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:24:14.392+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16611 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:24:19.398 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:24:19.394+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16630 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:24:21.708 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:24:21.712 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:24:24.400 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:24:24.397+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16651 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:24:29.403 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:24:29.400+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16670 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:24:34.406 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:24:34.402+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16693 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:24:39.408 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:24:39.405+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16712 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:24:44.411 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:24:44.408+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16733 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:24:49.414 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:24:49.412+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16752 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:24:51.784 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:24:51.787 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:24:54.417 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:24:54.414+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16773 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:24:59.419 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:24:59.417+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16794 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:25:04.422 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:25:04.420+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16813 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:25:09.425 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:25:09.422+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16834 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:25:14.428 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:25:14.424+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16855 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:25:19.430 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:25:19.427+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16876 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:25:21.851 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:25:21.854 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:25:24.433 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:25:24.430+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16895 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:25:29.436 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:25:29.433+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16916 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:25:34.439 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:25:34.436+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16937 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:25:39.442 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:25:39.439+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16958 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:25:44.445 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:25:44.442+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16977 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:25:49.447 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:25:49.445+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16998 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:25:52.005 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:25:52.008 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:25:54.450 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:25:54.447+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17019 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:25:59.453 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:25:59.450+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17040 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:26:04.456 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:26:04.452+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17059 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:26:09.459 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:26:09.455+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17080 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:26:14.461 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:26:14.458+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17101 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:26:19.464 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:26:19.461+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17122 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:26:22.102 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:26:22.105 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:26:24.467 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:26:24.464+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17141 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:26:29.469 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:26:29.467+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17162 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:26:34.472 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:26:34.470+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17183 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:26:39.475 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:26:39.472+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17204 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:26:44.477 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:26:44.474+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17223 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:26:49.480 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:26:49.476+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17244 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:26:52.259 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:26:52.262 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:26:54.483 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:26:54.479+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17265 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:26:59.485 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:26:59.482+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17286 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:27:04.488 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:27:04.485+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17305 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:27:09.491 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:27:09.488+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17326 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:27:14.494 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:27:14.491+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17347 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:27:19.497 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:27:19.494+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17368 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:27:22.339 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:27:22.342 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:27:24.500 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:27:24.497+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17387 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:27:29.502 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:27:29.499+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17408 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:27:34.505 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:27:34.502+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17429 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:27:39.508 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:27:39.504+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17450 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:27:44.511 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:27:44.507+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17469 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:27:49.514 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:27:49.510+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17489 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:27:52.478 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:27:52.481 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:27:54.516 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:27:54.514+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17511 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:27:59.520 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:27:59.517+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17530 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:28:04.522 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:28:04.519+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17551 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:28:09.525 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:28:09.522+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17570 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:28:14.528 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:28:14.524+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17593 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:28:19.531 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:28:19.527+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17612 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:28:22.546 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:28:22.549 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:28:24.534 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:28:24.530+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17633 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:28:29.536 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:28:29.533+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17652 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:28:34.539 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:28:34.536+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17675 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:28:39.542 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:28:39.539+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17694 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:28:44.545 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:28:44.542+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17715 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:28:49.547 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:28:49.545+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17734 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:28:52.699 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:28:52.702 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:28:54.550 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:28:54.548+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17757 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:28:59.553 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:28:59.551+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17776 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:29:04.556 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:29:04.552+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17797 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:29:09.559 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:29:09.555+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17816 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:29:14.562 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:29:14.558+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17839 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:29:19.565 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:29:19.562+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17858 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:29:22.837 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:29:22.840 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:29:24.568 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:29:24.565+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17879 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:29:29.571 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:29:29.569+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17898 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:29:34.574 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:29:34.571+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17921 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:29:39.577 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:29:39.574+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17940 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:29:44.579 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:29:44.577+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17961 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:29:49.582 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:29:49.579+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17980 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:29:52.951 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:29:52.954 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:29:54.585 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:29:54.582+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18003 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:29:59.589 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:29:59.585+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18022 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:30:04.591 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:30:04.588+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18043 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:30:09.594 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:30:09.591+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18062 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:30:14.597 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:30:14.594+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18085 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:30:19.600 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:30:19.598+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18104 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:30:23.066 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:30:23.068 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:30:24.603 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:30:24.600+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18125 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:30:29.606 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:30:29.603+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18144 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:30:34.609 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:30:34.606+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18167 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:30:39.612 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:30:39.608+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18186 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:30:44.615 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:30:44.611+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18207 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:30:49.618 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:30:49.614+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18226 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:30:53.172 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:30:53.174 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:30:54.620 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:30:54.617+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18248 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:30:59.625 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:30:59.620+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18268 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:31:04.627 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:31:04.624+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18287 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:31:09.629 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:31:09.627+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18308 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:31:14.632 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:31:14.629+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18329 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:31:19.635 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:31:19.632+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18350 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:31:23.260 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:31:23.263 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:31:24.637 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:31:24.634+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18369 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:31:29.640 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:31:29.637+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18390 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:31:34.643 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:31:34.639+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18411 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:31:39.646 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:31:39.642+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18432 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:31:44.654 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:31:44.645+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18451 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:31:49.651 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:31:49.649+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18472 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:31:53.391 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:31:53.393 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:31:54.654 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:31:54.652+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18493 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:31:59.657 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:31:59.654+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18514 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:32:04.884 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:32:04.657+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18533 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:32:09.663 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:32:09.659+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18554 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:32:14.666 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:32:14.662+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18575 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:32:19.670 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:32:19.665+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18596 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:32:23.475 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:32:23.478 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:32:24.672 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:32:24.668+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18615 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:32:29.675 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:32:29.671+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18636 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:32:34.678 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:32:34.674+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18657 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:32:39.681 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:32:39.678+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18678 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:32:44.684 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:32:44.681+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18697 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:32:49.687 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:32:49.684+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18718 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:32:53.627 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:32:53.630 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:32:54.690 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:32:54.687+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18739 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:32:59.692 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:32:59.689+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18760 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:33:04.695 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:33:04.692+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18779 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:33:09.698 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:33:09.695+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18800 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:33:14.701 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:33:14.697+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18821 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:33:19.704 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:33:19.700+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18842 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:33:23.767 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:33:23.770 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:33:24.707 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:33:24.704+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18861 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:33:29.711 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:33:29.707+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18882 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:33:34.713 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:33:34.710+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18903 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:33:39.716 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:33:39.713+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18924 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:33:44.719 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:33:44.715+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18943 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:33:49.722 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:33:49.718+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18964 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:33:53.864 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:33:53.867 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:33:54.725 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:33:54.721+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18985 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:33:59.728 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:33:59.724+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19005 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:34:04.731 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:34:04.728+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19025 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:34:09.734 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:34:09.731+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19044 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:34:14.737 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:34:14.735+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19067 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:34:19.741 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:34:19.738+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19086 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:34:23.978 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:34:23.981 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:34:24.743 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:34:24.741+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19107 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:34:29.747 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:34:29.744+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19126 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:34:34.751 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:34:34.746+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19149 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:34:39.752 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:34:39.748+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19168 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:34:44.755 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:34:44.751+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19189 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:34:49.758 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:34:49.754+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19208 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:34:54.118 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:34:54.121 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:34:54.761 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:34:54.758+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19231 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:34:59.764 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:34:59.762+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19250 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:35:04.767 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:35:04.764+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19271 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:35:09.770 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:35:09.767+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19290 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:35:14.773 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:35:14.771+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19313 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:35:19.776 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:35:19.772+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19332 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:35:24.247 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:35:24.251 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:35:24.779 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:35:24.775+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19353 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:35:29.782 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:35:29.778+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19372 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:35:34.785 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:35:34.781+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19395 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:35:39.788 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:35:39.784+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19414 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:35:44.790 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:35:44.788+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19435 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:35:49.794 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:35:49.791+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19454 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:35:54.379 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:35:54.382 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:35:54.796 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:35:54.794+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19477 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:35:59.799 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:35:59.796+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19496 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:36:04.802 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:36:04.798+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19517 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:36:09.805 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:36:09.801+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19536 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:36:14.808 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:36:14.804+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19559 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:36:19.811 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:36:19.807+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19578 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:36:24.518 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:36:24.521 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:36:24.820 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:36:24.810+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19599 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:36:29.817 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:36:29.813+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19618 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:36:34.820 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:36:34.817+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19641 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:36:39.823 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:36:39.820+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19660 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:36:44.826 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:36:44.824+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19681 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:36:49.829 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:36:49.827+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19700 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:36:54.591 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:36:54.593 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:36:54.832 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:36:54.829+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19723 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:36:59.836 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:36:59.832+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19742 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:37:04.838 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:37:04.835+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19763 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:37:09.842 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:37:09.838+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19782 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:37:14.844 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:37:14.841+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19803 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:37:19.847 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:37:19.845+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19824 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:37:24.737 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:37:24.740 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:37:24.850 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:37:24.847+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19843 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:37:29.853 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:37:29.850+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19864 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:37:34.856 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:37:34.854+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19885 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:37:39.859 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:37:39.856+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19906 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:37:44.863 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:37:44.859+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19925 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:37:49.866 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:37:49.862+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19946 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:37:54.869 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:37:54.865+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19967 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:37:54.877 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:37:54.881 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:37:59.872 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:37:59.869+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19988 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:38:04.875 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:38:04.873+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20007 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:38:09.880 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:38:09.875+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20028 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:38:14.881 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:38:14.879+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20049 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:38:19.885 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:38:19.882+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20070 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:38:24.887 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:38:24.884+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20089 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:38:24.987 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:38:24.990 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:38:29.891 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:38:29.887+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20110 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:38:34.894 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:38:34.890+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20131 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:38:39.897 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:38:39.893+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20152 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:38:44.900 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:38:44.896+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20171 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:38:49.903 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:38:49.899+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20192 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:38:54.906 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:38:54.903+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20213 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:38:55.138 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:38:55.141 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:38:59.909 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:38:59.906+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20234 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:39:04.912 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:39:04.910+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20253 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:39:09.915 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:39:09.913+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20274 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:39:14.919 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:39:14.915+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20295 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:39:19.922 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:39:19.918+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20316 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:39:24.925 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:39:24.921+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20335 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:39:25.253 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:39:25.256 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:39:29.928 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:39:29.924+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20356 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:39:34.931 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:39:34.927+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20377 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:39:39.934 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:39:39.931+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20398 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:39:44.937 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:39:44.935+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20417 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:39:49.941 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:39:49.938+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20438 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:39:54.944 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:39:54.941+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20459 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:39:55.401 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:39:55.403 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:39:59.946 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:39:59.944+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20480 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:40:04.950 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:40:04.946+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20499 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:40:09.953 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:40:09.949+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20520 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:40:14.956 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:40:14.952+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20541 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:40:19.959 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:40:19.956+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20560 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:40:24.962 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:40:24.959+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20581 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:40:25.548 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:40:25.551 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:40:29.965 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:40:29.963+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20600 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:40:34.968 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:40:34.966+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20623 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:40:39.972 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:40:39.969+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20642 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:40:44.975 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:40:44.972+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20663 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:40:49.978 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:40:49.975+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20682 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:40:54.988 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:40:54.977+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20705 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:40:55.656 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:40:55.659 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:40:59.984 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:40:59.980+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20724 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:41:04.987 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:41:04.983+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20745 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:41:09.994 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:41:09.986+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20764 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:41:14.993 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:41:14.990+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20787 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:41:19.997 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:41:19.994+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20806 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:41:25.001 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:41:24.997+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20827 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:41:25.785 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:41:25.788 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:41:30.003 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:41:30.000+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20846 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:41:35.006 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:41:35.004+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20869 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:41:40.010 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:41:40.006+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20888 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:41:45.013 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:41:45.009+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20909 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:41:50.015 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:41:50.012+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20928 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:41:55.019 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:41:55.015+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20951 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:41:55.914 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:41:55.916 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:42:00.022 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:42:00.018+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20970 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:42:05.025 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:42:05.022+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20991 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:42:10.029 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:42:10.026+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21010 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:42:15.032 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:42:15.030+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21033 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:42:20.036 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:42:20.033+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21052 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:42:25.039 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:42:25.036+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21073 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:42:26.056 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:42:26.059 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:42:30.042 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:42:30.038+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21092 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:42:35.045 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:42:35.042+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21115 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:42:40.049 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:42:40.045+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21134 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:42:45.052 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:42:45.049+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21155 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:42:50.055 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:42:50.052+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21174 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:42:55.059 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:42:55.056+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21197 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:42:56.202 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:42:56.205 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:43:00.062 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:43:00.059+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21216 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:43:05.065 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:43:05.063+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21237 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:43:10.069 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:43:10.066+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21257 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:43:15.072 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:43:15.068+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21279 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:43:20.075 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:43:20.071+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21298 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:43:25.078 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:43:25.074+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21317 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:43:26.333 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:43:26.335 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:43:30.081 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:43:30.078+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21340 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:43:35.085 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:43:35.081+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21359 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:43:40.088 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:43:40.084+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21380 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:43:45.092 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:43:45.089+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21399 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:43:50.095 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:43:50.092+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21422 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:43:55.099 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:43:55.096+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21441 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:43:56.482 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:43:56.485 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:44:00.102 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:44:00.099+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21462 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:44:05.105 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:44:05.101+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21481 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:44:10.108 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:44:10.104+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21504 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:44:15.112 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:44:15.108+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21523 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:44:20.115 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:44:20.111+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21544 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:44:25.119 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:44:25.115+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21563 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:44:26.629 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:44:26.632 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:44:30.122 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:44:30.119+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21586 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:44:35.125 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:44:35.122+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21605 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:44:40.128 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:44:40.126+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21626 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:44:45.132 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:44:45.129+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21645 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:44:50.135 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:44:50.131+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21668 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:44:55.138 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:44:55.135+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21687 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:44:56.744 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:44:56.748 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:45:00.141 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:45:00.138+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21708 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:45:05.145 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:45:05.141+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21727 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:45:10.148 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:45:10.144+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21750 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:45:15.152 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:45:15.149+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21769 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:45:20.155 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:45:20.152+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21790 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:45:25.158 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:45:25.156+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21809 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:45:26.850 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:45:26.852 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:45:30.162 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:45:30.159+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21832 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:45:35.165 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:45:35.161+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21851 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:45:40.168 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:45:40.165+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21872 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:45:45.172 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:45:45.168+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21891 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:45:50.175 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:45:50.172+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21914 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:45:55.179 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:45:55.175+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21933 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:45:56.922 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:45:56.924 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:46:00.182 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:46:00.178+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21954 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:46:05.187 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:46:05.183+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21973 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:46:10.189 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:46:10.186+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21996 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:46:15.192 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:46:15.189+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22015 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:46:20.195 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:46:20.193+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22036 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:46:25.199 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:46:25.195+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22055 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:46:27.077 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:46:27.079 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:46:30.202 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:46:30.198+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22077 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:46:35.205 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:46:35.202+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22097 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:46:40.209 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:46:40.205+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22116 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:46:45.212 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:46:45.208+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22137 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:46:50.216 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:46:50.213+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22158 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:46:55.219 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:46:55.216+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22179 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:46:57.215 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:46:57.218 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:47:00.222 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:47:00.220+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22198 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:47:05.226 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:47:05.223+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22219 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:47:10.229 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:47:10.225+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22240 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:47:15.232 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:47:15.229+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22261 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:47:20.236 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:47:20.232+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22280 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:47:25.239 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:47:25.236+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22301 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:47:27.328 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:47:27.331 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:47:30.243 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:47:30.239+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22322 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:47:35.246 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:47:35.243+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22343 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:47:40.250 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:47:40.248+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22362 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:47:45.254 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:47:45.251+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22383 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:47:50.257 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:47:50.254+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22404 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:47:55.261 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:47:55.258+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22425 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:47:57.465 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:47:57.467 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:48:00.264 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:48:00.261+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22444 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:48:05.268 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:48:05.264+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22465 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:48:10.271 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:48:10.267+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22486 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:48:15.274 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:48:15.271+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22507 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:48:20.278 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:48:20.274+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22526 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:48:25.281 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:48:25.278+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22547 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:48:27.587 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:48:27.590 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:48:30.284 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:48:30.282+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22568 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:48:35.288 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:48:35.285+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22589 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:48:40.292 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:48:40.289+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22608 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:48:45.295 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:48:45.291+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22629 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:48:50.299 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:48:50.295+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22650 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:48:55.303 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:48:55.298+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22671 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:48:57.736 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:48:57.739 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:49:00.306 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:49:00.302+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22690 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:49:05.309 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:49:05.305+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22711 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:49:10.313 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:49:10.309+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22732 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:49:15.316 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:49:15.313+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22753 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:49:20.320 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:49:20.317+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22772 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:49:25.323 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:49:25.320+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22792 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:49:27.863 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:49:27.866 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:49:30.327 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:49:30.324+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22813 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:49:35.330 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:49:35.326+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22834 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:49:40.334 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:49:40.330+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22853 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:49:45.338 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:49:45.334+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22872 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:49:50.341 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:49:50.337+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22895 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:49:55.345 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:49:55.341+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22914 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:49:58.010 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:49:58.013 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:50:00.348 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:50:00.345+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22935 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:50:05.352 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:50:05.349+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22954 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:50:10.355 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:50:10.353+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22977 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:50:15.359 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:50:15.356+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22996 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:50:20.362 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:50:20.359+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23017 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:50:25.366 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:50:25.362+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23036 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:50:28.123 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:50:28.126 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:50:30.369 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:50:30.366+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23059 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:50:35.373 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:50:35.369+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23078 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:50:40.377 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:50:40.373+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23099 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:50:45.380 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:50:45.377+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23118 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:50:50.383 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:50:50.381+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23141 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:50:55.387 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:50:55.384+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23160 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:50:58.239 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:50:58.242 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:51:00.390 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:51:00.387+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23181 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:51:05.394 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:51:05.390+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23200 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:51:10.398 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:51:10.394+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23223 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:51:15.401 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:51:15.397+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23242 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:51:20.405 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:51:20.401+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23263 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:51:25.409 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:51:25.405+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23282 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:51:28.386 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:51:28.389 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:51:30.412 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:51:30.409+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23305 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:51:35.416 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:51:35.413+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23324 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:51:40.419 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:51:40.417+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23345 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:51:45.424 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:51:45.421+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23364 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:51:50.427 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:51:50.424+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23387 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:51:55.431 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:51:55.427+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23406 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:51:58.508 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:51:58.511 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:52:00.434 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:52:00.431+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23427 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:52:05.438 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:52:05.434+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23446 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:52:10.442 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:52:10.438+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23469 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:52:15.446 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:52:15.442+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23488 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:52:20.450 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:52:20.447+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23509 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:52:25.453 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:52:25.451+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23528 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:52:28.657 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:52:28.659 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:52:30.457 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:52:30.454+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23551 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:52:35.461 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:52:35.458+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23570 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:52:40.464 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:52:40.460+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23591 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:52:45.468 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:52:45.464+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23610 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:52:50.472 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:52:50.468+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23632 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:52:55.476 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:52:55.472+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23652 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:52:58.786 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:52:58.790 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:53:00.479 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:53:00.476+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23671 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:53:05.483 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:53:05.479+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23692 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:53:10.486 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:53:10.483+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23713 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:53:15.490 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:53:15.487+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23734 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:53:20.494 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:53:20.491+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23753 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:53:25.498 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:53:25.495+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23774 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:53:28.934 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:53:28.936 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:53:30.501 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:53:30.497+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23795 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:53:35.505 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:53:35.501+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23816 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:53:40.508 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:53:40.505+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23835 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:53:45.512 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:53:45.508+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23856 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:53:50.515 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:53:50.511+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23877 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:53:55.519 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:53:55.516+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23898 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:53:59.065 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:53:59.067 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:54:00.523 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:54:00.520+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23918 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:54:05.529 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:54:05.524+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23938 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:54:10.531 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:54:10.528+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23960 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:54:15.534 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:54:15.530+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23980 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:54:20.538 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:54:20.534+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24000 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:54:25.542 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:54:25.538+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24020 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:54:29.194 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:54:29.197 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:54:30.545 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:54:30.541+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24042 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:54:35.549 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:54:35.545+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24062 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:54:40.553 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:54:40.549+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24082 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:54:45.557 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:54:45.554+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24102 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:54:50.560 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:54:50.558+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24124 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:54:55.564 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:54:55.562+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24144 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:54:59.348 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:54:59.351 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:55:00.569 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:55:00.566+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24164 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:55:05.572 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:55:05.568+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24184 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:55:10.576 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:55:10.572+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24206 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:55:15.580 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:55:15.576+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24226 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:55:20.583 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:55:20.579+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24246 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:55:25.587 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:55:25.583+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24266 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:55:29.494 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:55:29.497 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:55:30.590 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:55:30.588+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24288 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:55:35.593 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:55:35.590+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24308 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:55:40.597 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:55:40.594+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24328 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:55:45.601 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:55:45.598+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24348 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:55:50.604 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:55:50.601+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24370 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:55:55.608 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:55:55.604+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24390 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:55:59.644 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:55:59.647 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:56:00.614 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:56:00.607+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24410 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:56:05.615 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:56:05.611+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24428 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:56:10.618 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:56:10.615+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24452 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:56:15.622 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:56:15.619+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24470 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:56:20.626 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:56:20.623+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24492 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:56:25.630 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:56:25.627+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24510 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:56:29.754 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:56:29.757 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:56:30.633 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:56:30.631+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24534 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:56:35.637 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:56:35.633+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24552 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:56:40.641 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:56:40.637+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24574 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:56:45.645 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:56:45.641+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24592 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:56:50.649 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:56:50.645+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24616 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:56:55.652 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:56:55.649+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24634 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:56:59.866 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:56:59.869 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:57:00.656 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:57:00.652+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24656 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:57:05.660 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:57:05.657+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24674 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:57:10.664 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:57:10.661+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24698 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:57:15.668 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:57:15.665+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24716 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:57:20.672 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:57:20.669+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24738 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:57:25.676 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:57:25.672+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24756 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:57:30.004 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:57:30.008 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:57:30.679 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:57:30.675+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24780 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:57:35.683 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:57:35.679+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24798 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:57:40.687 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:57:40.683+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24820 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:57:45.691 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:57:45.687+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24838 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:57:50.695 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:57:50.692+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24862 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:57:55.699 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:57:55.696+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24880 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:58:00.151 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:58:00.154 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:58:00.702 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:58:00.700+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24902 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:58:05.706 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:58:05.703+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24920 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:58:10.709 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:58:10.706+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24944 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:58:15.713 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:58:15.710+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24962 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:58:20.717 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:58:20.714+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24984 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:58:25.721 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:58:25.718+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25002 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:58:30.272 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:58:30.277 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:58:30.725 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:58:30.721+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25026 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:58:35.729 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:58:35.725+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25044 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:58:40.733 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:58:40.730+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25066 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:58:45.737 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:58:45.734+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25084 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:58:50.741 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:58:50.738+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25108 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:58:55.748 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:58:55.742+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25126 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:59:00.427 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:59:00.430 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:59:00.748 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:59:00.745+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25148 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:59:05.752 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:59:05.749+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25166 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:59:10.756 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:59:10.752+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25190 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:59:15.760 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:59:15.756+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25208 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:59:20.764 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:59:20.760+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25228 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:59:25.767 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:59:25.765+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25248 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:59:30.570 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:59:30.573 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:59:30.771 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:59:30.769+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25270 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:59:35.776 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:59:35.772+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25290 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:59:40.779 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:59:40.776+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25310 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:59:45.783 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:59:45.779+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25330 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:59:50.787 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:59:50.784+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25352 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:59:55.791 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T15:59:55.787+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25372 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:00:00.711 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:00:00.716 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:00:00.795 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:00:00.791+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25392 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:00:05.798 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:00:05.795+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25412 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:00:10.802 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:00:10.800+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25434 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:00:15.807 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:00:15.804+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25454 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:00:20.818 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:00:20.808+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25474 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:00:25.814 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:00:25.812+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25494 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:00:30.818 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:00:30.814+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25516 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:00:30.848 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:00:30.852 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:00:35.822 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:00:35.818+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25536 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:00:40.825 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:00:40.822+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25556 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:00:45.829 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:00:45.825+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25576 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:00:50.833 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:00:50.829+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25598 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:00:55.837 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:00:55.833+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25618 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:01:00.841 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:01:00.838+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25638 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:01:01.004 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:01:01.007 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:01:05.844 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:01:05.842+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25658 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:01:10.848 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:01:10.846+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25680 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:01:15.852 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:01:15.850+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25700 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:01:20.856 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:01:20.853+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25720 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:01:25.860 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:01:25.857+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25740 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:01:30.864 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:01:30.861+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25762 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:01:31.141 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:01:31.144 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:01:35.868 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:01:35.865+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25782 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:01:40.872 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:01:40.868+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25802 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:01:45.876 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:01:45.873+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25822 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:01:50.883 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:01:50.877+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25844 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:01:55.883 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:01:55.881+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25864 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:02:00.887 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:02:00.885+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25884 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:02:01.287 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:02:01.291 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:02:05.891 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:02:05.888+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25904 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:02:10.895 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:02:10.891+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25926 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:02:15.899 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:02:15.895+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25946 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:02:20.903 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:02:20.899+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25966 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:02:25.907 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:02:25.903+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25984 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:02:30.911 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:02:30.907+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26008 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:02:31.425 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:02:31.428 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:02:35.915 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:02:35.913+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26026 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:02:40.919 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:02:40.916+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26048 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:02:45.923 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:02:45.921+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26066 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:02:50.927 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:02:50.924+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26090 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:02:55.931 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:02:55.928+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26108 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:03:00.935 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:03:00.932+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26130 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:03:01.574 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:03:01.576 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:03:05.939 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:03:05.936+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26148 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:03:10.943 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:03:10.939+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26172 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:03:15.947 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:03:15.943+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26190 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:03:20.951 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:03:20.948+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26212 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:03:25.955 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:03:25.953+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26230 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:03:30.958 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:03:30.956+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26254 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:03:31.660 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:03:31.664 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:03:35.962 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:03:35.960+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26272 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:03:40.966 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:03:40.963+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26294 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:03:45.970 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:03:45.967+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26312 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:03:50.981 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:03:50.971+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26336 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:03:55.978 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:03:55.975+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26354 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:04:00.983 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:04:00.979+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26376 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:04:01.806 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:04:01.809 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:04:05.987 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:04:05.984+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26394 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:04:10.991 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:04:10.989+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26418 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:04:15.995 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:04:15.993+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26436 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:04:20.999 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:04:20.997+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26458 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:04:26.003 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:04:26.001+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26476 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:04:31.007 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:04:31.004+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26500 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:04:31.935 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:04:31.938 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:04:36.011 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:04:36.008+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26518 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:04:41.015 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:04:41.012+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26540 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:04:46.019 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:04:46.016+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26558 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:04:51.024 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:04:51.020+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26582 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:04:56.028 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:04:56.025+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26600 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:05:01.031 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:05:01.029+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26622 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:05:02.073 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:05:02.076 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:05:06.035 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:05:06.033+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26640 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:05:11.039 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:05:11.037+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26664 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:05:16.044 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:05:16.040+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26682 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:05:21.048 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:05:21.045+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26704 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:05:26.052 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:05:26.049+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26722 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:05:31.056 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:05:31.053+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26746 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:05:32.198 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:05:32.201 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:05:36.060 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:05:36.057+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26764 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:05:41.064 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:05:41.062+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26784 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:05:46.068 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:05:46.066+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26804 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:05:51.072 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:05:51.070+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26826 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:05:56.076 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:05:56.074+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26846 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:06:01.080 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:06:01.077+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26866 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:06:02.297 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:06:02.300 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:06:06.085 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:06:06.081+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26886 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:06:11.089 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:06:11.085+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26908 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:06:16.093 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:06:16.089+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26928 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:06:21.097 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:06:21.093+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26948 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:06:26.100 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:06:26.097+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26968 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:06:31.105 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:06:31.102+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26990 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:06:32.436 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:06:32.439 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:06:36.109 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:06:36.107+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27010 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:06:41.113 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:06:41.111+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27030 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:06:46.117 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:06:46.115+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27050 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:06:51.121 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:06:51.118+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27072 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:06:56.125 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:06:56.122+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27092 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:07:01.129 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:07:01.126+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27112 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:07:02.532 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:07:02.535 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:07:06.133 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:07:06.130+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27132 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:07:11.137 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:07:11.134+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27154 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:07:16.141 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:07:16.139+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27174 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:07:21.145 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:07:21.143+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27194 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:07:26.149 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:07:26.147+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27216 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:07:31.154 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:07:31.151+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27236 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:07:32.679 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:07:32.682 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:07:36.158 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:07:36.155+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27256 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:07:41.162 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:07:41.159+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27276 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:07:46.166 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:07:46.163+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27298 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:07:51.170 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:07:51.167+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27318 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:07:56.174 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:07:56.171+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27338 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:08:01.178 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:08:01.175+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27358 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:08:02.836 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:08:02.842 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:08:06.182 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:08:06.180+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27380 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:08:11.186 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:08:11.184+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27400 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:08:16.191 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:08:16.189+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27420 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:08:21.195 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:08:21.193+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27440 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:08:26.200 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:08:26.196+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27462 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:08:31.204 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:08:31.201+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27482 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:08:32.967 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:08:32.970 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:08:36.208 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:08:36.205+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27502 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:08:41.218 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:08:41.209+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27522 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:08:46.220 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:08:46.213+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27544 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:08:51.221 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:08:51.218+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27564 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:08:56.225 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:08:56.222+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27582 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:09:01.229 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:09:01.227+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27604 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:09:03.143 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:09:03.146 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:09:06.233 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:09:06.231+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27624 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:09:11.237 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:09:11.234+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27646 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:09:16.241 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:09:16.238+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27664 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:09:21.245 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:09:21.242+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27686 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:09:26.249 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:09:26.246+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27706 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:09:31.253 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:09:31.250+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27728 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:09:33.221 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:09:33.224 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:09:36.258 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:09:36.255+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27746 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:09:41.262 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:09:41.260+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27768 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:09:46.266 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:09:46.264+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27788 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:09:51.270 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:09:51.268+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27810 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:09:56.274 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:09:56.272+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27828 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:10:01.278 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:10:01.275+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27850 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:10:03.375 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:10:03.378 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:10:06.283 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:10:06.280+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27870 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:10:11.287 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:10:11.284+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27892 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:10:16.291 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:10:16.288+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27910 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:10:21.296 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:10:21.293+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27932 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:10:26.300 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:10:26.298+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27952 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:10:31.304 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:10:31.302+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27974 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:10:33.514 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:10:33.518 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:10:36.308 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:10:36.306+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27992 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:10:41.312 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:10:41.310+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28014 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:10:46.317 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:10:46.313+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28034 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:10:51.320 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:10:51.317+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28056 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:10:56.325 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:10:56.321+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28074 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:11:01.329 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:11:01.326+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28096 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:11:03.678 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:11:03.681 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:11:06.333 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:11:06.330+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28116 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:11:11.338 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:11:11.335+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28138 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:11:16.342 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:11:16.340+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28156 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:11:21.346 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:11:21.344+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28178 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:11:26.350 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:11:26.348+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28198 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:11:31.354 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:11:31.351+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28220 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:11:33.801 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:11:33.803 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:11:36.359 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:11:36.355+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28238 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:11:41.363 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:11:41.360+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28260 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:11:46.367 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:11:46.364+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28280 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:11:51.371 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:11:51.368+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28302 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:11:56.375 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:11:56.372+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28320 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:12:01.380 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:12:01.378+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28342 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:12:03.960 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:12:03.963 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:12:06.385 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:12:06.382+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28362 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:12:11.388 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:12:11.386+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28382 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:12:16.393 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:12:16.391+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28402 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:12:21.397 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:12:21.394+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28422 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:12:26.401 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:12:26.398+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28444 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:12:31.406 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:12:31.403+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28464 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:12:34.104 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:12:34.107 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:12:36.410 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:12:36.407+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28485 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:12:41.414 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:12:41.411+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28504 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:12:46.418 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:12:46.416+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28527 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:12:51.424 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:12:51.421+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28546 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:12:56.427 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:12:56.425+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28567 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:13:01.431 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:13:01.429+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28586 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:13:04.236 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:13:04.239 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:13:06.435 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:13:06.432+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28609 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:13:11.439 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:13:11.436+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28628 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:13:16.444 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:13:16.440+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28649 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:13:21.448 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:13:21.445+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28668 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:13:26.452 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:13:26.449+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28691 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:13:31.457 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:13:31.453+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28710 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:13:34.408 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:13:34.411 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:13:36.461 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:13:36.459+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28731 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:13:41.465 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:13:41.463+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28750 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:13:46.469 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:13:46.467+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28773 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:13:51.473 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:13:51.471+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28792 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:13:56.478 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:13:56.475+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28813 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:14:01.482 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:14:01.479+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28832 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:14:04.561 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:14:04.564 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:14:06.486 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:14:06.483+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28855 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:14:11.490 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:14:11.487+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28874 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:14:16.495 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:14:16.492+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28895 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:14:21.499 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:14:21.497+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28914 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:14:26.503 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:14:26.501+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28937 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:14:31.508 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:14:31.506+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28956 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:14:34.694 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:14:34.697 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:14:36.512 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:14:36.510+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28977 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:14:41.516 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:14:41.513+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28996 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:14:46.521 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:14:46.518+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29019 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:14:51.525 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:14:51.522+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29052 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:14:56.530 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:14:56.527+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29094 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:15:01.534 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:15:01.531+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29130 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:15:04.842 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:15:04.845 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:15:06.538 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:15:06.536+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29174 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:15:11.543 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:15:11.541+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29210 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:15:16.547 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:15:16.545+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29252 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:15:21.552 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:15:21.550+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29288 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:15:26.556 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:15:26.553+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29330 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:15:31.560 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:15:31.557+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29368 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:15:34.991 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:15:34.994 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:15:36.565 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:15:36.562+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29407 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:15:41.570 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:15:41.566+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29445 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:15:46.574 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:15:46.571+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29488 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:15:51.578 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:15:51.575+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29526 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:15:56.583 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:15:56.581+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29567 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:16:01.587 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:16:01.585+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29605 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:16:05.145 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:16:05.149 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:16:06.591 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:16:06.589+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29648 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:16:11.595 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:16:11.593+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29686 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:16:16.600 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:16:16.597+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29727 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:16:21.604 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:16:21.601+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29765 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:16:26.608 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:16:26.605+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29808 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:16:31.613 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:16:31.610+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29846 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:16:35.301 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:16:35.304 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:16:36.617 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:16:36.614+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29887 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:16:41.622 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:16:41.620+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29925 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:16:46.631 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:16:46.624+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29968 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:16:51.631 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:16:51.629+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30006 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:16:56.636 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:16:56.633+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30047 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:17:01.639 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:17:01.636+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30085 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:17:05.421 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:17:05.423 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:17:06.644 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:17:06.641+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30128 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:17:11.648 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:17:11.645+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30166 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:17:16.653 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:17:16.650+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30207 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:17:21.658 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:17:21.655+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30245 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:17:26.662 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:17:26.660+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30288 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:17:31.667 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:17:31.665+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30326 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:17:35.559 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:17:35.561 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:17:36.671 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:17:36.669+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30367 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:17:41.675 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:17:41.673+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30405 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:17:46.680 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:17:46.677+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30448 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:17:51.685 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:17:51.682+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30486 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:17:56.689 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:17:56.686+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30527 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:18:01.694 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:18:01.691+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30565 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:18:05.702 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:18:05.705 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:18:06.698 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:18:06.695+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30608 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:18:11.703 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:18:11.701+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30646 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:18:16.708 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:18:16.706+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30687 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:18:21.712 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:18:21.710+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30725 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:18:26.718 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:18:26.715+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30768 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:18:31.725 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:18:31.719+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30806 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:18:35.836 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:18:35.839 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:18:36.726 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:18:36.722+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30847 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:18:41.730 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:18:41.727+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30883 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:18:46.735 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:18:46.732+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30928 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:18:51.740 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:18:51.736+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30964 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:18:56.744 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:18:56.741+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31007 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:19:01.748 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:19:01.746+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31043 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:19:05.982 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:19:05.985 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:19:06.753 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:19:06.751+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31088 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:19:11.757 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:19:11.755+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31124 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:19:16.762 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:19:16.760+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31167 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:19:21.767 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:19:21.764+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31203 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:19:26.771 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:19:26.768+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31248 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:19:31.776 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:19:31.773+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31284 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:19:36.203 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:19:36.207 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:19:36.780 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:19:36.777+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31327 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:19:41.785 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:19:41.782+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31363 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:19:46.789 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:19:46.787+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31408 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:19:51.794 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:19:51.792+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31444 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:19:56.799 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:19:56.797+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31487 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:20:01.804 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:20:01.802+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31522 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:20:06.323 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:20:06.326 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:20:06.808 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:20:06.805+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31567 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:20:11.813 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:20:11.810+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31602 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:20:16.817 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:20:16.814+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31645 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:20:21.822 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:20:21.819+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31680 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:20:26.827 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:20:26.824+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31725 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:20:31.832 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:20:31.829+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31760 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:20:36.459 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:20:36.463 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:20:36.836 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:20:36.834+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31803 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:20:41.841 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:20:41.839+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31838 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:20:46.846 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:20:46.844+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31883 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:20:51.851 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:20:51.849+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31918 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:20:56.856 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:20:56.853+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31961 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:21:01.861 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:21:01.858+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31996 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:21:06.592 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:21:06.599 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:21:06.866 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:21:06.863+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32041 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:21:11.871 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:21:11.868+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32076 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:21:16.877 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:21:16.873+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32119 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:21:21.882 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:21:21.879+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32154 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:21:26.886 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:21:26.884+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32199 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:21:31.891 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:21:31.889+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32234 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:21:36.730 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:21:36.750 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:21:36.904 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:21:36.894+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32278 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:21:41.901 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:21:41.898+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32312 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:21:46.906 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:21:46.903+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32358 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:21:51.911 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:21:51.908+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32392 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:21:56.916 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:21:56.913+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32435 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:22:01.921 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:22:01.918+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32470 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:22:06.903 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:22:06.906 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:22:06.926 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:22:06.923+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32514 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:22:11.930 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:22:11.928+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32550 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:22:16.935 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:22:16.933+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32592 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:22:21.940 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:22:21.938+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32628 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:22:26.945 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:22:26.943+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32672 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:22:31.953 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:22:31.947+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32708 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:22:36.955 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:22:36.952+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32750 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:22:37.008 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:22:37.010 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:22:41.970 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:22:41.957+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32786 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:22:46.965 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:22:46.962+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32830 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:22:51.970 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:22:51.967+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32866 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:22:56.976 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:22:56.973+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32908 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:23:01.980 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:23:01.978+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32944 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:23:06.985 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:23:06.983+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32988 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:23:07.336 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:23:07.339 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:23:11.991 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:23:11.988+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33024 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:23:16.996 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:23:16.993+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33066 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:23:22.001 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:23:21.997+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33102 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:23:27.006 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:23:27.002+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33146 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:23:32.010 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:23:32.007+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33182 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:23:37.015 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:23:37.012+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33224 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:23:37.457 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:23:37.460 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:23:42.020 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:23:42.018+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33260 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:23:47.025 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:23:47.023+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33304 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:23:52.030 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:23:52.028+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33340 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:23:57.035 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:23:57.033+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33382 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:24:02.041 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:24:02.037+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33418 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:24:07.046 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:24:07.043+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33462 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:24:07.587 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:24:07.590 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:24:12.051 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:24:12.048+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33498 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:24:17.056 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:24:17.053+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33540 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:24:22.061 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:24:22.058+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33576 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:24:27.066 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:24:27.063+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33620 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:24:32.071 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:24:32.069+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33657 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:24:37.076 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:24:37.074+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33699 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:24:37.734 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:24:37.736 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:24:42.081 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:24:42.079+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33736 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:24:47.086 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:24:47.084+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33780 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:24:52.092 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:24:52.088+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33817 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:24:57.097 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:24:57.093+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33859 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:25:02.102 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:25:02.099+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33896 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:25:07.108 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:25:07.105+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33940 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:25:07.889 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:25:07.892 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:25:12.113 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:25:12.109+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33977 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:25:17.118 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:25:17.116+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 34019 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:25:22.123 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:25:22.121+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 34054 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:25:27.128 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:25:27.125+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 34100 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:25:32.133 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:25:32.131+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 34135 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:25:37.138 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:25:37.135+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 34179 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:25:38.036 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:25:38.039 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:25:42.143 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:25:42.140+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 34214 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:25:47.148 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:25:47.145+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 34260 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:25:52.154 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:25:52.151+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 34295 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:25:57.158 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:25:57.155+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 34339 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:26:02.164 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:26:02.160+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 34374 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:26:07.169 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:26:07.167+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 34420 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:26:08.181 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:26:08.202 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:26:12.174 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:26:12.172+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 34455 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:26:17.179 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:26:17.177+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 34499 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:26:22.184 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:26:22.182+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 34534 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:26:27.189 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:26:27.186+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 34580 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:26:32.195 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:26:32.191+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 34614 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:26:37.200 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:26:37.197+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 34658 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:26:38.258 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:26:38.261 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:26:42.205 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:26:42.202+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 34694 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:26:47.210 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:26:47.207+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 34738 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:26:52.216 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:26:52.214+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 34772 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:26:57.221 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:26:57.219+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 34816 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:27:02.227 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:27:02.224+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 34852 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:27:07.232 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:27:07.230+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 34896 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:27:08.413 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:27:08.422 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:27:12.237 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:27:12.235+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 34930 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:27:17.242 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:27:17.239+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 34974 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:27:22.248 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:27:22.244+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 35010 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:27:27.253 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:27:27.250+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 35054 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:27:32.259 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:27:32.255+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 35088 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:27:37.264 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:27:37.260+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 35132 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:27:38.573 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:27:38.576 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:27:42.269 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:27:42.267+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 35168 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:27:47.274 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:27:47.272+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 35212 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:27:52.279 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:27:52.277+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 35246 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:27:57.284 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:27:57.282+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 35290 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:28:02.289 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:28:02.286+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 35326 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:28:07.294 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:28:07.291+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 35370 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:28:08.717 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:28:08.720 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:28:12.300 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:28:12.297+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 35404 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:28:17.309 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:28:17.302+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 35448 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:28:22.310 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:28:22.307+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 35484 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:28:27.316 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:28:27.313+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 35528 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:28:32.321 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:28:32.319+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 35562 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:28:37.326 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:28:37.324+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 35606 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:28:38.873 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:28:38.876 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:28:42.332 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:28:42.329+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 35642 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:28:47.336 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:28:47.333+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 35684 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:28:52.341 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:28:52.338+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 35720 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:28:57.347 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:28:57.344+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 35762 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:29:02.352 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:29:02.349+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 35800 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:29:07.357 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:29:07.354+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 35842 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:29:09.015 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:29:09.017 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:29:12.362 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:29:12.359+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 35878 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:29:17.368 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:29:17.365+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 35920 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:29:22.373 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:29:22.371+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 35958 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:29:27.378 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:29:27.376+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 36000 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:29:32.383 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:29:32.381+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 36036 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:29:37.389 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:29:37.386+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 36078 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:29:39.150 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:29:39.153 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:29:42.394 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:29:42.391+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 36116 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:29:47.400 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:29:47.396+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 36158 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:29:52.405 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:29:52.402+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 36194 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:29:57.410 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:29:57.407+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 36236 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:30:02.416 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:30:02.414+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 36274 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:30:07.421 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:30:07.419+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 36316 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:30:09.271 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:30:09.274 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:30:12.430 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:30:12.424+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 36352 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:30:17.434 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:30:17.429+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 36394 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:30:22.437 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:30:22.433+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 36432 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:30:27.442 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:30:27.439+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 36474 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:30:32.447 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:30:32.444+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 36510 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:30:37.453 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:30:37.449+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 36552 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:30:39.410 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:30:39.413 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:30:42.458 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:30:42.455+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 36590 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:30:47.464 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:30:47.460+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 36632 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:30:52.469 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:30:52.467+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 36668 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:30:57.475 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:30:57.472+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 36710 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:31:02.480 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:31:02.478+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 36748 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:31:07.486 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:31:07.484+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 36790 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:31:09.574 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:31:09.577 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:31:12.492 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:31:12.488+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 36826 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:31:17.497 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:31:17.493+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 36868 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:31:22.502 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:31:22.499+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 36906 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:31:27.507 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:31:27.504+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 36948 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:31:32.529 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:31:32.510+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 36984 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:31:37.519 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:31:37.516+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 37026 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:31:39.735 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:31:39.738 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:31:42.524 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:31:42.522+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 37065 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:31:47.531 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:31:47.527+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 37107 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:31:52.535 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:31:52.533+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 37144 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:31:57.541 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:31:57.537+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 37186 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:32:02.546 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:32:02.543+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 37225 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:32:07.551 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:32:07.548+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 37267 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:32:10.057 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:32:10.060 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:32:12.557 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:32:12.554+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 37302 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:32:17.562 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:32:17.559+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 37346 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:32:22.567 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:32:22.564+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 37383 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:32:27.572 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:32:27.570+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 37427 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:32:32.578 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:32:32.576+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 37462 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:32:37.583 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:32:37.581+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 37506 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:32:40.178 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:32:40.181 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:32:42.588 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:32:42.586+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 37543 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:32:47.594 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:32:47.591+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 37587 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:32:52.600 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:32:52.596+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 37622 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:32:57.605 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:32:57.602+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 37666 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:33:02.611 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:33:02.607+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 37703 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:33:07.617 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:33:07.613+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 37747 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:33:10.317 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:33:10.319 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:33:12.622 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:33:12.620+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 37782 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:33:17.627 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:33:17.625+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 37826 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:33:22.633 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:33:22.631+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 37863 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:33:27.638 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:33:27.636+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 37907 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:33:32.644 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:33:32.641+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 37942 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:33:37.650 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:33:37.646+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 37986 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:33:40.446 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:33:40.450 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:33:42.655 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:33:42.652+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 38023 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:33:47.660 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:33:47.657+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 38067 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:33:52.666 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:33:52.663+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 38102 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:33:57.672 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:33:57.669+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 38146 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:34:02.677 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:34:02.675+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 38183 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:34:07.683 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:34:07.680+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 38227 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:34:10.616 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:34:10.619 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:34:12.689 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:34:12.686+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 38262 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:34:17.694 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:34:17.692+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 38306 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:34:22.699 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:34:22.696+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 38343 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:34:27.705 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:34:27.702+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 38387 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:34:32.710 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:34:32.707+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 38422 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:34:37.716 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:34:37.713+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 38466 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:34:40.756 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:34:40.759 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:34:42.721 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:34:42.718+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 38503 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:34:47.727 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:34:47.725+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 38546 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:34:52.734 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:34:52.730+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 38581 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:34:57.738 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:34:57.735+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 38624 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:35:02.743 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:35:02.741+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 38661 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:35:07.749 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:35:07.745+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 38704 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:35:10.885 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:35:10.888 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:35:12.754 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:35:12.751+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 38739 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:35:17.759 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:35:17.756+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 38782 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:35:22.765 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:35:22.762+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 38819 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:35:27.770 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:35:27.767+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 38862 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:35:32.775 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:35:32.773+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 38897 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:35:37.781 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:35:37.779+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 38938 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:35:41.060 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:35:41.063 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:35:42.787 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:35:42.785+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 38977 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:35:47.792 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:35:47.790+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 39018 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:35:52.798 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:35:52.796+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 39055 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:35:57.804 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:35:57.800+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 39096 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:36:02.809 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:36:02.806+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 39135 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:36:07.815 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:36:07.812+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 39176 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:36:11.206 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:36:11.214 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:36:12.820 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:36:12.817+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 39213 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:36:17.826 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:36:17.823+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 39254 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:36:22.831 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:36:22.829+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 39292 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:36:27.837 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:36:27.835+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 39333 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:36:32.842 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:36:32.840+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 39369 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:36:37.848 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:36:37.846+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 39411 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:36:41.392 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:36:41.394 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:36:42.853 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:36:42.850+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 39449 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:36:47.859 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:36:47.856+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 39491 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:36:52.865 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:36:52.861+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 39527 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:36:57.870 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:36:57.867+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 39569 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:37:02.876 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:37:02.873+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 39607 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:37:07.882 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:37:07.879+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 39649 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:37:11.504 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:37:11.506 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:37:12.887 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:37:12.885+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 39685 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:37:17.893 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:37:17.891+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 39727 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:37:22.899 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:37:22.897+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 39765 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:37:27.904 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:37:27.901+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 39807 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:37:32.910 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:37:32.907+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 39843 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:37:37.916 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:37:37.913+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 39885 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:37:41.625 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:37:41.635 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:37:42.922 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:37:42.919+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 39923 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:37:47.927 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:37:47.924+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 39965 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:37:52.933 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:37:52.930+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 40001 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:37:57.939 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:37:57.937+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 40043 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:38:02.945 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:38:02.943+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 40081 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:38:07.953 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:38:07.949+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 40123 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:38:11.765 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:38:11.768 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:38:12.957 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:38:12.955+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 40159 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:38:17.963 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:38:17.960+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 40201 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:38:22.969 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:38:22.965+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 40239 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:38:27.974 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:38:27.971+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 40281 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:38:32.980 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:38:32.977+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 40317 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:38:37.986 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:38:37.983+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 40359 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:38:41.909 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:38:41.912 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:38:42.992 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:38:42.990+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 40397 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:38:47.998 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:38:47.996+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 40439 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:38:53.004 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:38:53.002+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 40475 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:38:58.010 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:38:58.008+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 40517 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:39:03.016 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:39:03.014+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 40553 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:39:08.022 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:39:08.019+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 40597 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:39:12.051 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:39:12.054 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:39:13.027 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:39:13.024+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 40631 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:39:18.033 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:39:18.030+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 40675 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:39:23.039 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:39:23.036+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 40711 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:39:28.045 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:39:28.042+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 40755 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:39:33.051 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:39:33.048+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 40789 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:39:38.057 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:39:38.055+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 40833 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:39:42.168 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:39:42.171 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:39:43.063 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:39:43.060+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 40869 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:39:48.069 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:39:48.066+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 40913 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:39:53.074 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:39:53.072+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 40947 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:39:58.080 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:39:58.077+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 40991 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:40:03.085 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:40:03.082+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 41027 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:40:08.091 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:40:08.088+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 41071 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:40:12.332 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:40:12.336 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:40:13.097 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:40:13.094+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 41105 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:40:18.103 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:40:18.100+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 41150 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:40:23.109 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:40:23.107+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 41186 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:40:28.116 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:40:28.113+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 41231 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:40:33.130 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:40:33.119+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 41265 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:40:38.127 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:40:38.125+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 41310 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:40:42.495 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:40:42.498 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:40:43.144 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:40:43.131+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 41346 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:40:48.140 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:40:48.136+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 41391 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:40:53.145 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:40:53.142+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 41425 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:40:58.151 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:40:58.148+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 41470 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:41:03.156 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:41:03.153+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 41507 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:41:08.163 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:41:08.159+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 41551 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:41:12.667 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:41:12.670 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:41:13.168 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:41:13.166+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 41586 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:41:18.174 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:41:18.172+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 41630 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:41:23.180 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:41:23.178+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 41667 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:41:28.186 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:41:28.184+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 41711 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:41:33.192 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:41:33.189+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 41746 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:41:38.198 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:41:38.195+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 41790 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:41:42.808 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:41:42.812 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:41:43.204 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:41:43.201+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 41827 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:41:48.215 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:41:48.207+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 41871 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:41:53.215 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:41:53.212+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 41906 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:41:58.221 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:41:58.218+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 41950 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:42:03.227 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:42:03.225+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 41987 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:42:08.233 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:42:08.231+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42032 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:42:12.959 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:42:12.962 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:42:13.239 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:42:13.237+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42067 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:42:18.245 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:42:18.243+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42113 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:42:23.251 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:42:23.248+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42149 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:42:28.257 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:42:28.254+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42192 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:42:33.263 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:42:33.260+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42229 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:42:38.268 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:42:38.265+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42274 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:42:43.221 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:42:43.224 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:42:43.274 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:42:43.271+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42311 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:42:48.280 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:42:48.278+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42354 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:42:53.286 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:42:53.284+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42391 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:42:58.292 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:42:58.290+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42436 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:43:03.346 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:43:03.296+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42472 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:43:08.304 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:43:08.301+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42515 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:43:13.293 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:43:13.300 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:43:13.310 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:43:13.307+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42551 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:43:18.317 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:43:18.314+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42596 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:43:23.323 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:43:23.320+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42632 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:43:28.329 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:43:28.326+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42675 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:43:33.335 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:43:33.332+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42711 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:43:38.342 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:43:38.339+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42756 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:43:43.347 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:43:43.345+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42792 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:43:43.430 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:43:43.432 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:43:48.353 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:43:48.351+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42835 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:43:53.360 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:43:53.358+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42871 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:43:58.369 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:43:58.363+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42916 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:44:03.372 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:44:03.369+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42952 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:44:08.378 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:44:08.375+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42995 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:44:13.384 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:44:13.381+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 43031 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:44:13.580 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:44:13.583 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:44:18.391 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:44:18.387+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 43076 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:44:23.396 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:44:23.394+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 43112 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:44:28.403 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:44:28.401+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 43155 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:44:33.409 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:44:33.407+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 43191 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:44:38.415 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:44:38.413+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 43236 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:44:43.421 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:44:43.418+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 43272 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:44:43.706 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:44:43.709 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:44:48.428 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:44:48.425+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 43315 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:44:53.434 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:44:53.431+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 43351 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:44:58.440 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:44:58.437+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 43396 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:45:03.446 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:45:03.443+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 43432 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:45:08.452 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:45:08.450+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 43475 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:45:13.458 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:45:13.456+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 43511 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:45:13.819 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:45:13.822 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:45:18.464 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:45:18.462+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 43556 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:45:23.470 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:45:23.468+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 43592 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:45:28.476 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:45:28.474+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 43635 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:45:33.482 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:45:33.479+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 43671 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:45:38.489 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:45:38.486+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 43716 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:45:43.495 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:45:43.492+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 43752 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:45:43.965 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:45:43.967 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:45:48.501 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:45:48.498+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 43795 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:45:53.506 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:45:53.503+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 43831 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:45:58.513 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:45:58.511+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 43876 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:46:03.519 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:46:03.517+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 43910 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:46:08.525 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:46:08.523+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 43955 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:46:13.531 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:46:13.529+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 43989 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:46:14.096 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:46:14.099 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:46:18.538 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:46:18.534+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 44036 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:46:23.544 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:46:23.541+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 44070 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:46:28.550 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:46:28.547+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 44115 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:46:33.556 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:46:33.553+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 44149 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:46:38.562 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:46:38.559+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 44196 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:46:43.568 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:46:43.566+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 44230 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:46:44.231 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:46:44.234 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:46:48.574 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:46:48.572+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 44275 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:46:53.581 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:46:53.579+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 44309 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:46:58.586 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:46:58.584+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 44356 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:47:03.593 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:47:03.590+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 44390 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:47:08.598 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:47:08.595+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 44435 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:47:13.604 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:47:13.601+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 44469 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:47:14.391 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:47:14.393 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:47:18.611 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:47:18.608+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 44514 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:47:23.617 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:47:23.614+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 44548 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:47:28.626 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:47:28.621+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 44589 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:47:33.630 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:47:33.627+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 44623 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:47:38.637 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:47:38.633+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 44664 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:47:43.642 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:47:43.640+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 44698 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:47:44.517 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:47:44.520 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:47:48.648 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:47:48.646+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 44737 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:47:53.654 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:47:53.650+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 44771 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:47:58.660 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:47:58.657+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 44812 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:48:03.666 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:48:03.663+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 44846 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:48:08.672 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:48:08.669+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 44885 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:48:13.679 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:48:13.676+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 44919 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:48:14.677 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:48:14.680 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:48:18.685 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:48:18.683+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 44960 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:48:23.691 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:48:23.689+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 44994 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:48:28.698 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:48:28.696+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45033 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:48:33.704 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:48:33.702+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45067 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:48:38.711 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:48:38.708+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45108 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:48:43.717 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:48:43.714+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45142 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:48:44.833 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:48:44.835 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:48:48.725 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:48:48.721+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45181 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:48:53.731 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:48:53.727+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45215 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:48:58.737 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:48:58.734+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45256 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:49:03.744 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:49:03.741+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45290 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:49:08.750 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:49:08.748+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45329 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:49:13.756 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:49:13.754+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45363 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:49:14.930 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:49:14.933 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:49:18.763 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:49:18.761+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45404 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:49:23.769 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:49:23.767+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45438 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:49:28.776 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:49:28.773+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45475 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:49:33.782 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:49:33.779+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45511 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:49:38.789 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:49:38.786+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45550 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:49:43.795 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:49:43.792+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45586 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:49:45.067 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:49:45.070 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:49:48.802 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:49:48.798+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45623 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:49:53.808 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:49:53.806+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45659 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:49:58.814 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:49:58.812+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45698 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:50:03.820 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:50:03.818+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45734 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:50:08.827 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:50:08.825+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45771 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:50:13.833 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:50:13.830+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45807 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:50:15.189 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:50:15.191 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:50:18.840 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:50:18.836+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45846 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:50:23.846 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:50:23.843+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45882 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:50:28.852 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:50:28.849+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45919 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:50:33.861 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:50:33.855+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45955 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:50:38.865 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:50:38.863+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 45994 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:50:43.871 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:50:43.869+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 46030 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:50:45.350 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:50:45.352 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:50:48.877 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:50:48.875+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 46068 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:50:53.884 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:50:53.881+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 46104 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:50:58.890 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:50:58.887+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 46144 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:51:03.897 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:51:03.894+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 46180 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:51:08.903 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:51:08.900+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 46218 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:51:13.909 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:51:13.906+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 46254 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:51:15.531 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:51:15.534 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:51:18.916 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:51:18.913+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 46294 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:51:23.922 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:51:23.920+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 46331 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:51:28.929 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:51:28.927+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 46368 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:51:33.935 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:51:33.933+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 46405 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:51:38.942 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:51:38.940+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 46444 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:51:43.948 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:51:43.946+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 46481 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:51:45.668 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:51:45.671 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:51:48.954 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:51:48.951+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 46518 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:51:53.960 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:51:53.957+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 46555 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:51:58.967 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:51:58.964+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 46594 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:52:03.973 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:52:03.970+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 46631 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:52:08.979 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:52:08.976+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 46668 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:52:13.986 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:52:13.984+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 46705 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:52:15.790 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:52:15.793 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:52:18.993 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:52:18.990+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 46744 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:52:23.999 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:52:23.997+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 46781 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:52:29.006 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:52:29.004+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 46817 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:52:34.012 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:52:34.009+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 46854 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:52:39.019 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:52:39.016+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 46892 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:52:44.026 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:52:44.023+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 46929 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:52:45.928 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:52:45.931 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:52:49.032 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:52:49.029+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 46965 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:52:54.038 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:52:54.035+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47002 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:52:59.045 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:52:59.042+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47040 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:53:04.051 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:53:04.049+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47075 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:53:09.058 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:53:09.055+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47113 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:53:14.064 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:53:14.062+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47148 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:53:16.214 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:53:16.217 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:53:19.071 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:53:19.069+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47188 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:53:24.077 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:53:24.074+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47223 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:53:29.084 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:53:29.081+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47261 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:53:34.090 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:53:34.087+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47296 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:53:39.097 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:53:39.094+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47336 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:53:44.103 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:53:44.100+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47371 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:53:46.289 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:53:46.292 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:53:49.110 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:53:49.108+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47409 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:53:54.116 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:53:54.114+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47443 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:53:59.123 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:53:59.121+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47483 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:54:04.129 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:54:04.127+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47519 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:54:09.136 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:54:09.133+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47557 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:54:14.142 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:54:14.139+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47593 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:54:16.435 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:54:16.438 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:54:19.148 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:54:19.145+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47633 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:54:24.157 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:54:24.152+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47669 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:54:29.162 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:54:29.159+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47707 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:54:34.168 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:54:34.166+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47743 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:54:39.175 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:54:39.173+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47783 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:54:44.182 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:54:44.179+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47819 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:54:46.573 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:54:46.577 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:54:49.188 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:54:49.186+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47857 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:54:54.194 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:54:54.192+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47893 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:54:59.201 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:54:59.198+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47933 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:55:04.207 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:55:04.204+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 47969 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:55:09.214 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:55:09.211+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48007 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:55:14.220 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:55:14.217+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48043 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:55:16.721 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:55:16.724 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:55:19.227 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:55:19.224+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48083 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:55:24.234 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:55:24.231+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48119 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:55:29.241 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:55:29.238+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48157 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:55:34.247 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:55:34.245+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48193 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:55:39.254 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:55:39.252+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48233 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:55:44.261 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:55:44.257+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48269 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:55:46.852 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:55:46.856 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:55:49.267 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:55:49.264+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48307 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:55:54.274 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:55:54.271+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48343 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:55:59.280 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:55:59.277+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48383 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:56:04.289 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:56:04.284+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48419 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:56:09.293 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:56:09.290+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48457 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:56:14.300 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:56:14.298+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48495 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:56:16.991 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:56:16.995 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:56:19.306 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:56:19.304+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48533 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:56:24.313 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:56:24.311+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48569 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:56:29.319 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:56:29.317+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48607 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:56:34.326 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:56:34.323+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48645 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:56:39.332 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:56:39.329+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48682 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:56:44.339 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:56:44.336+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48720 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:56:47.151 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:56:47.154 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:56:49.346 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:56:49.342+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48757 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:56:54.352 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:56:54.349+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48797 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:56:59.359 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:56:59.357+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48834 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:57:04.366 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:57:04.364+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48872 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:57:09.373 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:57:09.371+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48910 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:57:14.380 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:57:14.378+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48949 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:57:17.280 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:57:17.283 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:57:19.390 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:57:19.383+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 48987 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:57:24.393 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:57:24.390+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 49024 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:57:29.400 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:57:29.397+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 49061 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:57:34.407 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:57:34.404+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 49100 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:57:39.413 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:57:39.410+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 49137 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:57:44.420 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:57:44.417+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 49174 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:57:47.418 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:57:47.421 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:57:49.426 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:57:49.424+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 49211 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:57:54.433 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:57:54.431+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 49250 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:57:59.440 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:57:59.438+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 49287 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:58:04.447 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:58:04.445+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 49324 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:58:09.453 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:58:09.451+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 49361 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:58:14.468 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:58:14.457+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 49400 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:58:17.573 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:58:17.578 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:58:19.467 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:58:19.464+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 49437 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:58:24.474 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:58:24.471+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 49474 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:58:29.480 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:58:29.477+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 49511 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:58:34.494 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:58:34.484+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 49550 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:58:39.494 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:58:39.492+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 49587 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:58:44.501 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:58:44.499+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 49624 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:58:47.703 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:58:47.706 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:58:49.514 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:58:49.506+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 49661 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:58:54.515 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:58:54.513+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 49700 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:58:59.522 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:58:59.519+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 49737 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:59:04.529 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:59:04.526+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 49774 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:59:09.537 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:59:09.534+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 49811 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:59:14.543 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:59:14.541+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 49850 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:59:17.834 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:59:17.837 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:59:19.550 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:59:19.547+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 49887 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:59:24.558 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:59:24.556+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 49924 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:59:29.564 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:59:29.562+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 49961 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:59:34.574 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:59:34.569+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 50000 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:59:39.582 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:59:39.575+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 50037 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:59:44.584 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:59:44.581+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 50074 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:59:47.976 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:59:47.978 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:59:49.590 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:59:49.587+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 50111 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:59:54.597 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:59:54.594+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 50150 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:59:59.604 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T16:59:59.601+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 50187 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:00:04.617 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:00:04.608+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 50224 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:00:09.618 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:00:09.615+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 50261 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:00:14.625 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:00:14.623+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 50298 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:00:18.025 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:00:18.028 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:00:19.632 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:00:19.630+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 50337 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:00:24.639 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:00:24.637+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 50374 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:00:29.646 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:00:29.644+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 50412 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:00:34.653 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:00:34.650+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 50452 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:00:39.660 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:00:39.657+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 50490 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:00:44.667 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:00:44.664+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 50531 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:00:48.156 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:00:48.159 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:00:49.674 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:00:49.671+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 50569 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:00:54.680 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:00:54.678+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 50612 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:00:59.688 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:00:59.686+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 50650 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:01:04.695 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:01:04.693+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 50691 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:01:09.702 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:01:09.700+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 50729 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:01:14.709 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:01:14.707+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 50772 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:01:18.219 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:01:18.222 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:01:19.717 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:01:19.713+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 50810 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:01:24.723 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:01:24.720+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 50851 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:01:29.730 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:01:29.727+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 50889 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:01:34.737 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:01:34.734+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 50932 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:01:39.744 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:01:39.741+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 50970 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:01:44.751 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:01:44.749+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 51011 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:01:48.365 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:01:48.369 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:01:49.758 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:01:49.756+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 51049 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:01:54.765 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:01:54.763+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 51092 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:01:59.772 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:01:59.770+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 51130 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:02:04.778 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:02:04.777+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 51171 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:02:09.786 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:02:09.783+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 51209 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:02:14.793 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:02:14.790+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 51252 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:02:18.479 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:02:18.482 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:02:19.800 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:02:19.797+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 51290 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:02:24.810 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:02:24.804+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 51331 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:02:29.814 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:02:29.811+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 51369 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:02:34.821 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:02:34.819+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 51412 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:02:39.828 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:02:39.826+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 51450 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:02:44.835 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:02:44.833+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 51491 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:02:48.618 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:02:48.621 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:02:49.842 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:02:49.840+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 51529 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:02:54.849 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:02:54.846+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 51572 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:02:59.856 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:02:59.853+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 51610 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:03:04.863 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:03:04.860+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 51651 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:03:09.871 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:03:09.868+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 51689 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:03:14.878 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:03:14.875+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 51732 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:03:18.864 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:03:18.866 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:03:19.885 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:03:19.883+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 51770 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:03:24.892 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:03:24.890+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 51811 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:03:29.899 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:03:29.897+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 51849 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:03:34.905 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:03:34.903+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 51892 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:03:39.912 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:03:39.909+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 51930 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:03:44.919 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:03:44.916+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 51971 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:03:48.927 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:03:48.930 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:03:49.926 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:03:49.923+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 52007 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:03:54.933 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:03:54.930+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 52052 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:03:59.940 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:03:59.937+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 52088 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:04:04.947 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:04:04.944+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 52131 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:04:09.954 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:04:09.952+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 52167 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:04:14.961 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:04:14.959+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 52212 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:04:19.081 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:04:19.087 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:04:19.968 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:04:19.966+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 52248 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:04:24.976 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:04:24.974+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 52291 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:04:29.983 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:04:29.980+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 52327 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:04:34.990 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:04:34.987+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 52372 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:04:39.997 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:04:39.994+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 52408 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:04:45.005 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:04:45.002+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 52451 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:04:49.211 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:04:49.214 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:04:50.012 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:04:50.009+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 52487 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:04:55.019 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:04:55.017+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 52532 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:05:00.026 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:05:00.025+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 52568 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:05:05.034 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:05:05.032+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 52612 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:05:10.041 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:05:10.039+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 52648 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:05:15.048 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:05:15.045+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 52694 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:05:19.315 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:05:19.318 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:05:20.056 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:05:20.052+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 52730 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:05:25.063 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:05:25.060+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 52774 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:05:30.070 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:05:30.067+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 52810 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:05:35.077 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:05:35.074+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 52856 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:05:40.084 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:05:40.082+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 52892 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:05:45.091 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:05:45.090+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 52936 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:05:49.462 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:05:49.465 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:05:50.099 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:05:50.097+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 52972 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:05:55.106 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:05:55.104+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 53018 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:06:00.113 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:06:00.110+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 53053 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:06:05.120 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:06:05.117+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 53097 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:06:10.127 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:06:10.124+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 53132 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:06:15.134 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:06:15.131+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 53178 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:06:19.609 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:06:19.612 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:06:20.142 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:06:20.138+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 53213 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:06:25.149 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:06:25.146+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 53257 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:06:30.155 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:06:30.153+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 53292 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:06:35.163 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:06:35.161+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 53338 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:06:40.171 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:06:40.169+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 53373 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:06:45.177 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:06:45.175+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 53417 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:06:49.755 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:06:49.758 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:06:50.185 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:06:50.182+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 53452 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:06:55.191 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:06:55.188+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 53498 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:07:00.199 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:07:00.195+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 53533 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:07:05.206 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:07:05.203+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 53577 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:07:10.214 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:07:10.210+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 53612 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:07:15.220 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:07:15.218+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 53658 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:07:19.900 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:07:19.903 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:07:20.228 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:07:20.226+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 53693 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:07:25.235 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:07:25.233+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 53737 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:07:30.242 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:07:30.240+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 53772 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:07:35.250 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:07:35.247+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 53816 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:07:40.257 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:07:40.254+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 53853 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:07:45.264 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:07:45.261+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 53895 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:07:50.031 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:07:50.036 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:07:50.271 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:07:50.268+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 53932 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:07:55.279 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:07:55.276+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 53976 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:08:00.286 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:08:00.283+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 54013 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:08:05.306 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:08:05.292+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 54055 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:08:10.302 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:08:10.300+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 54092 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:08:15.309 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:08:15.307+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 54136 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:08:20.103 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:08:20.106 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:08:20.316 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:08:20.314+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 54173 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:08:25.323 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:08:25.320+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 54215 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:08:30.333 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:08:30.328+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 54254 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:08:35.338 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:08:35.335+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 54296 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:08:40.345 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:08:40.342+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 54333 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:08:45.352 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:08:45.349+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 54375 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:08:50.253 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:08:50.259 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:08:50.359 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:08:50.357+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 54414 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:08:55.366 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:08:55.364+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 54456 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:09:00.374 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:09:00.371+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 54493 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:09:05.381 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:09:05.380+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 54535 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:09:10.389 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:09:10.386+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 54574 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:09:15.398 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:09:15.393+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 54616 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:09:20.403 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:09:20.401+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 54653 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:09:20.413 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:09:20.415 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:09:25.410 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:09:25.407+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 54695 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:09:30.418 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:09:30.415+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 54734 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:09:35.426 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:09:35.424+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 54777 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:09:40.433 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:09:40.431+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 54814 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:09:45.440 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:09:45.438+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 54857 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:09:50.448 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:09:50.446+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 54896 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:09:50.558 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:09:50.562 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:09:55.455 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:09:55.453+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 54939 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:10:00.462 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:10:00.459+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 54976 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:10:05.469 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:10:05.466+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 55019 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:10:10.476 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:10:10.473+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 55058 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:10:15.483 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:10:15.481+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 55101 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:10:20.491 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:10:20.488+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 55138 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:10:20.692 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:10:20.695 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:10:25.499 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:10:25.497+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 55181 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:10:30.506 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:10:30.504+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 55220 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:10:35.514 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:10:35.512+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 55263 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:10:40.521 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:10:40.519+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 55300 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:10:45.529 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:10:45.526+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 55343 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:10:50.537 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:10:50.534+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 55382 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:10:50.860 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:10:50.863 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:10:55.544 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:10:55.541+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 55425 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:11:00.552 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:11:00.549+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 55462 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:11:05.560 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:11:05.557+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 55505 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:11:10.567 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:11:10.565+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 55543 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:11:15.575 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:11:15.572+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 55588 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:11:20.582 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:11:20.580+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 55622 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:11:20.956 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:11:20.959 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:11:25.589 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:11:25.587+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 55668 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:11:30.596 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:11:30.593+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 55704 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:11:35.603 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:11:35.600+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 55750 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:11:40.611 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:11:40.608+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 55784 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:11:45.619 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:11:45.616+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 55830 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:11:50.626 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:11:50.623+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 55866 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:11:51.116 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:11:51.119 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:11:55.633 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:11:55.631+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 55912 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:12:00.641 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:12:00.639+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 55946 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:12:05.648 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:12:05.646+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 55992 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:12:10.656 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:12:10.654+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 56028 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:12:15.663 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:12:15.661+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 56074 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:12:20.665 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:12:20.662+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:20.664327+0000) 2020-02-12T17:12:20.666 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:12:20.663+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:20.664495+0000) 2020-02-12T17:12:20.667 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:12:20.663+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:20.664656+0000) 2020-02-12T17:12:20.667 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:12:20.663+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:20.664838+0000) 2020-02-12T17:12:20.667 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:12:20.663+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:20.665195+0000) 2020-02-12T17:12:20.668 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:12:20.663+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:20.665343+0000) 2020-02-12T17:12:20.668 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:12:20.664+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:20.665598+0000) 2020-02-12T17:12:20.668 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:12:20.663+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:20.665163+0000) 2020-02-12T17:12:20.668 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:12:20.664+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:20.665524+0000) 2020-02-12T17:12:20.668 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:12:20.664+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:20.665853+0000) 2020-02-12T17:12:20.669 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:12:20.664+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:20.666169+0000) 2020-02-12T17:12:20.670 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:20.667+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:20.669516+0000) 2020-02-12T17:12:20.671 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:12:20.668+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 56108 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:12:20.671 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:20.669+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:20.669803+0000) 2020-02-12T17:12:20.671 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:20.669+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:20.670058+0000) 2020-02-12T17:12:21.254 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:12:21.257 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:12:21.998 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:12:21.996+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:21.997072+0000) 2020-02-12T17:12:22.231 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:12:22.229+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:22.230404+0000) 2020-02-12T17:12:24.368 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:24.366+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:24.367155+0000) 2020-02-12T17:12:24.474 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:12:24.472+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:24.472636+0000) 2020-02-12T17:12:24.477 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:12:24.475+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:24.476585+0000) 2020-02-12T17:12:24.486 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:12:24.484+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:24.484955+0000) 2020-02-12T17:12:24.495 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:12:24.493+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:24.494160+0000) 2020-02-12T17:12:24.496 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:12:24.493+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:24.494423+0000) 2020-02-12T17:12:24.496 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:12:24.493+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:24.494442+0000) 2020-02-12T17:12:24.860 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:24.858+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:24.859286+0000) 2020-02-12T17:12:25.246 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:12:25.244+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:25.244885+0000) 2020-02-12T17:12:25.673 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:12:25.671+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:25.671664+0000) 2020-02-12T17:12:25.673 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:12:25.671+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:25.671957+0000) 2020-02-12T17:12:25.674 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:12:25.670+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:25.671980+0000) 2020-02-12T17:12:25.675 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:12:25.670+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:25.672134+0000) 2020-02-12T17:12:25.675 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:12:25.671+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:25.672797+0000) 2020-02-12T17:12:25.675 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:12:25.671+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:25.672958+0000) 2020-02-12T17:12:25.675 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:12:25.671+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:25.673202+0000) 2020-02-12T17:12:25.676 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:12:25.671+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:25.672195+0000) 2020-02-12T17:12:25.676 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:12:25.672+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:25.673367+0000) 2020-02-12T17:12:25.676 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:12:25.672+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:25.673513+0000) 2020-02-12T17:12:25.677 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:12:25.672+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:25.673893+0000) 2020-02-12T17:12:25.677 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:25.673+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:25.674181+0000) 2020-02-12T17:12:25.677 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:25.675+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:25.676220+0000) 2020-02-12T17:12:25.678 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:25.676+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:25.677140+0000) 2020-02-12T17:12:25.678 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:12:25.675+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 56155 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:12:25.927 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:25.925+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:25.925652+0000) 2020-02-12T17:12:27.741 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:12:27.738+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:27.739820+0000) 2020-02-12T17:12:27.987 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:12:27.985+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:27.986262+0000) 2020-02-12T17:12:30.680 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:12:30.677+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:30.679324+0000) 2020-02-12T17:12:30.681 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:12:30.678+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:30.679515+0000) 2020-02-12T17:12:30.682 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:30.679+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:30.679882+0000) 2020-02-12T17:12:30.682 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:12:30.679+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:30.680072+0000) 2020-02-12T17:12:30.682 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:12:30.678+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:30.679730+0000) 2020-02-12T17:12:30.682 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:12:30.678+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:30.679996+0000) 2020-02-12T17:12:30.682 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:12:30.679+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:30.680454+0000) 2020-02-12T17:12:30.683 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:12:30.679+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:30.680449+0000) 2020-02-12T17:12:30.684 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:12:30.680+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:30.680813+0000) 2020-02-12T17:12:30.684 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:12:30.680+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:30.681097+0000) 2020-02-12T17:12:30.684 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:30.680+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:30.681467+0000) 2020-02-12T17:12:30.684 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:12:30.679+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:30.680998+0000) 2020-02-12T17:12:30.685 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:12:30.679+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:30.681310+0000) 2020-02-12T17:12:30.685 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:30.683+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:30.683726+0000) 2020-02-12T17:12:30.686 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:12:30.683+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 56191 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:12:31.998 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:12:31.996+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:31.997273+0000) 2020-02-12T17:12:32.234 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:12:32.230+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:32.230613+0000) 2020-02-12T17:12:34.371 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:34.370+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:34.370386+0000) 2020-02-12T17:12:34.474 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:12:34.472+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:34.472833+0000) 2020-02-12T17:12:34.478 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:12:34.476+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:34.476781+0000) 2020-02-12T17:12:34.486 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:12:34.484+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:34.485161+0000) 2020-02-12T17:12:34.495 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:12:34.493+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:34.494315+0000) 2020-02-12T17:12:34.496 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:12:34.493+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:34.494600+0000) 2020-02-12T17:12:34.496 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:12:34.493+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:34.494599+0000) 2020-02-12T17:12:34.860 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:34.859+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:34.859445+0000) 2020-02-12T17:12:35.246 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:12:35.244+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:35.245102+0000) 2020-02-12T17:12:35.688 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:12:35.685+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:35.686791+0000) 2020-02-12T17:12:35.688 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:12:35.686+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:35.687002+0000) 2020-02-12T17:12:35.689 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:12:35.685+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:35.687134+0000) 2020-02-12T17:12:35.689 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:12:35.686+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:35.687622+0000) 2020-02-12T17:12:35.690 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:35.687+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:35.687663+0000) 2020-02-12T17:12:35.690 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:12:35.687+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:35.687917+0000) 2020-02-12T17:12:35.690 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:12:35.688+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:35.688797+0000) 2020-02-12T17:12:35.690 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:12:35.686+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:35.688117+0000) 2020-02-12T17:12:35.691 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:12:35.687+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:35.688474+0000) 2020-02-12T17:12:35.691 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:12:35.687+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:35.688643+0000) 2020-02-12T17:12:35.692 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:12:35.688+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:35.688984+0000) 2020-02-12T17:12:35.692 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:35.688+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:35.689006+0000) 2020-02-12T17:12:35.692 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:35.689+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:35.690400+0000) 2020-02-12T17:12:35.692 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:12:35.688+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:35.689178+0000) 2020-02-12T17:12:35.693 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:12:35.691+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 56238 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:12:35.927 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:35.925+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:35.925822+0000) 2020-02-12T17:12:37.741 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:12:37.739+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:37.739989+0000) 2020-02-12T17:12:37.988 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:12:37.986+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:37.986457+0000) 2020-02-12T17:12:40.696 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:12:40.693+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:40.694473+0000) 2020-02-12T17:12:40.697 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:12:40.693+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:40.694705+0000) 2020-02-12T17:12:40.697 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:12:40.692+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:40.693934+0000) 2020-02-12T17:12:40.697 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:12:40.693+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:40.695212+0000) 2020-02-12T17:12:40.698 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:40.694+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:40.694892+0000) 2020-02-12T17:12:40.699 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:40.695+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:40.695681+0000) 2020-02-12T17:12:40.699 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:12:40.694+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:40.695104+0000) 2020-02-12T17:12:40.699 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:12:40.694+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:40.695454+0000) 2020-02-12T17:12:40.699 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:12:40.695+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:40.695777+0000) 2020-02-12T17:12:40.699 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:12:40.695+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:40.695964+0000) 2020-02-12T17:12:40.700 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:12:40.695+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:40.696424+0000) 2020-02-12T17:12:40.700 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:12:40.694+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:40.695474+0000) 2020-02-12T17:12:40.700 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:12:40.695+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:40.696540+0000) 2020-02-12T17:12:40.701 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:40.699+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:40.699979+0000) 2020-02-12T17:12:40.701 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:12:40.698+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 56272 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:12:41.999 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:12:41.996+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:41.997487+0000) 2020-02-12T17:12:42.232 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:12:42.230+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:42.230772+0000) 2020-02-12T17:12:44.375 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:44.373+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:44.373478+0000) 2020-02-12T17:12:44.474 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:12:44.472+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:44.473029+0000) 2020-02-12T17:12:44.478 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:12:44.476+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:44.476975+0000) 2020-02-12T17:12:44.489 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:12:44.485+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:44.485327+0000) 2020-02-12T17:12:44.495 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:12:44.493+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:44.494442+0000) 2020-02-12T17:12:44.496 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:12:44.494+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:44.494761+0000) 2020-02-12T17:12:44.496 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:12:44.494+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:44.494770+0000) 2020-02-12T17:12:44.860 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:44.859+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:44.859605+0000) 2020-02-12T17:12:45.246 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:12:45.244+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:45.245310+0000) 2020-02-12T17:12:45.703 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:12:45.701+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:45.702056+0000) 2020-02-12T17:12:45.704 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:45.701+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:45.702300+0000) 2020-02-12T17:12:45.705 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:12:45.702+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:45.702605+0000) 2020-02-12T17:12:45.705 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:12:45.702+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:45.702748+0000) 2020-02-12T17:12:45.705 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:12:45.702+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:45.702937+0000) 2020-02-12T17:12:45.706 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:12:45.702+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:45.703255+0000) 2020-02-12T17:12:45.706 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:12:45.702+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:45.702554+0000) 2020-02-12T17:12:45.706 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:12:45.702+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:45.703194+0000) 2020-02-12T17:12:45.706 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:12:45.703+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:45.703444+0000) 2020-02-12T17:12:45.706 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:12:45.703+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:45.703560+0000) 2020-02-12T17:12:45.707 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:12:45.703+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:45.703648+0000) 2020-02-12T17:12:45.707 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:45.703+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:45.704354+0000) 2020-02-12T17:12:45.708 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:12:45.703+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:45.703996+0000) 2020-02-12T17:12:45.708 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:45.706+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:45.707123+0000) 2020-02-12T17:12:45.708 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:12:45.706+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 56319 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:12:45.927 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:45.925+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:45.925987+0000) 2020-02-12T17:12:47.741 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:12:47.739+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:47.740167+0000) 2020-02-12T17:12:47.988 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:12:47.986+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:47.986655+0000) 2020-02-12T17:12:50.710 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:12:50.708+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:50.709135+0000) 2020-02-12T17:12:50.711 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:12:50.709+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:50.709484+0000) 2020-02-12T17:12:50.711 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:12:50.709+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:50.709527+0000) 2020-02-12T17:12:50.712 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:12:50.708+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:50.709616+0000) 2020-02-12T17:12:50.712 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:50.708+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:50.709875+0000) 2020-02-12T17:12:50.713 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:50.709+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:50.710822+0000) 2020-02-12T17:12:50.713 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:12:50.708+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:50.709983+0000) 2020-02-12T17:12:50.713 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:12:50.708+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:50.710237+0000) 2020-02-12T17:12:50.713 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:12:50.708+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:50.710373+0000) 2020-02-12T17:12:50.714 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:12:50.709+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:50.710918+0000) 2020-02-12T17:12:50.714 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:12:50.709+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:50.710177+0000) 2020-02-12T17:12:50.714 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:12:50.710+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:50.710641+0000) 2020-02-12T17:12:50.714 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:12:50.710+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:50.711047+0000) 2020-02-12T17:12:50.716 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:50.713+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:50.715097+0000) 2020-02-12T17:12:50.716 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:12:50.714+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 56355 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:12:51.415 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:12:51.422 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:12:51.999 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:12:51.997+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:51.997684+0000) 2020-02-12T17:12:52.232 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:12:52.229+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:52.230927+0000) 2020-02-12T17:12:54.378 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:54.375+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:54.376640+0000) 2020-02-12T17:12:54.474 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:12:54.472+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:54.473200+0000) 2020-02-12T17:12:54.478 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:12:54.476+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:54.477132+0000) 2020-02-12T17:12:54.486 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:12:54.484+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:54.485523+0000) 2020-02-12T17:12:54.495 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:12:54.493+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:54.494631+0000) 2020-02-12T17:12:54.496 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:12:54.494+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:54.494895+0000) 2020-02-12T17:12:54.496 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:12:54.494+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:54.494895+0000) 2020-02-12T17:12:54.861 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:54.858+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:54.859781+0000) 2020-02-12T17:12:55.247 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:12:55.245+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:55.245537+0000) 2020-02-12T17:12:55.718 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:12:55.716+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:55.716921+0000) 2020-02-12T17:12:55.719 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:12:55.715+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:55.717146+0000) 2020-02-12T17:12:55.719 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:12:55.715+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:55.717310+0000) 2020-02-12T17:12:55.719 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:55.716+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:55.717769+0000) 2020-02-12T17:12:55.719 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:12:55.717+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:55.717489+0000) 2020-02-12T17:12:55.720 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:12:55.717+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:55.717931+0000) 2020-02-12T17:12:55.721 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:12:55.716+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:55.718001+0000) 2020-02-12T17:12:55.721 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:55.716+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:55.718142+0000) 2020-02-12T17:12:55.721 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:12:55.716+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:55.718250+0000) 2020-02-12T17:12:55.722 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:12:55.717+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:55.718831+0000) 2020-02-12T17:12:55.722 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:12:55.717+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:55.718375+0000) 2020-02-12T17:12:55.722 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:12:55.718+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:55.718578+0000) 2020-02-12T17:12:55.722 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:12:55.718+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:55.718774+0000) 2020-02-12T17:12:55.723 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:55.720+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:55.722182+0000) 2020-02-12T17:12:55.724 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:12:55.722+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 56402 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:12:55.928 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:12:55.924+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:55.926131+0000) 2020-02-12T17:12:57.741 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:12:57.740+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:57.740359+0000) 2020-02-12T17:12:57.988 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:12:57.985+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:12:57.986804+0000) 2020-02-12T17:13:00.726 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:13:00.724+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:00.724601+0000) 2020-02-12T17:13:00.726 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:00.723+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:00.724975+0000) 2020-02-12T17:13:00.727 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:13:00.723+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:00.725330+0000) 2020-02-12T17:13:00.727 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:13:00.724+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:00.725178+0000) 2020-02-12T17:13:00.727 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:13:00.725+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:00.725540+0000) 2020-02-12T17:13:00.728 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:00.724+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:00.725696+0000) 2020-02-12T17:13:00.728 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:13:00.724+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:00.725882+0000) 2020-02-12T17:13:00.729 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:13:00.724+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:00.726012+0000) 2020-02-12T17:13:00.729 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:13:00.725+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:00.726675+0000) 2020-02-12T17:13:00.729 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:13:00.725+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:00.726801+0000) 2020-02-12T17:13:00.729 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:13:00.725+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:00.726128+0000) 2020-02-12T17:13:00.729 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:13:00.725+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:00.726243+0000) 2020-02-12T17:13:00.730 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:13:00.726+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:00.726578+0000) 2020-02-12T17:13:00.730 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:00.728+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:00.729760+0000) 2020-02-12T17:13:00.731 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:13:00.730+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 56436 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:13:01.999 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:13:01.997+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:01.997856+0000) 2020-02-12T17:13:02.232 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:13:02.230+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:02.231136+0000) 2020-02-12T17:13:04.381 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:04.378+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:04.379770+0000) 2020-02-12T17:13:04.474 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:13:04.472+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:04.473384+0000) 2020-02-12T17:13:04.478 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:13:04.475+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:04.477310+0000) 2020-02-12T17:13:04.486 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:13:04.484+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:04.485682+0000) 2020-02-12T17:13:04.496 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:13:04.493+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:04.494813+0000) 2020-02-12T17:13:04.496 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:13:04.493+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:04.495090+0000) 2020-02-12T17:13:04.496 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:13:04.493+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:04.495088+0000) 2020-02-12T17:13:04.861 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:04.859+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:04.859956+0000) 2020-02-12T17:13:05.247 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:13:05.244+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:05.245756+0000) 2020-02-12T17:13:05.733 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:13:05.730+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:05.732229+0000) 2020-02-12T17:13:05.733 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:13:05.730+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:05.732417+0000) 2020-02-12T17:13:05.735 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:05.731+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:05.732759+0000) 2020-02-12T17:13:05.735 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:13:05.731+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:05.733044+0000) 2020-02-12T17:13:05.735 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:13:05.731+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:05.733389+0000) 2020-02-12T17:13:05.735 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:13:05.731+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:05.733458+0000) 2020-02-12T17:13:05.735 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:13:05.732+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:05.733622+0000) 2020-02-12T17:13:05.736 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:13:05.731+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:05.733200+0000) 2020-02-12T17:13:05.736 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:13:05.732+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:05.733692+0000) 2020-02-12T17:13:05.736 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:13:05.732+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:05.733822+0000) 2020-02-12T17:13:05.736 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:13:05.732+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:05.734110+0000) 2020-02-12T17:13:05.737 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:05.732+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:05.734198+0000) 2020-02-12T17:13:05.737 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:13:05.732+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:05.734557+0000) 2020-02-12T17:13:05.739 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:05.736+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:05.738071+0000) 2020-02-12T17:13:05.739 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:13:05.736+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 56483 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:13:05.927 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:05.925+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:05.926281+0000) 2020-02-12T17:13:07.742 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:13:07.739+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:07.740549+0000) 2020-02-12T17:13:07.988 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:13:07.986+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:07.986928+0000) 2020-02-12T17:13:10.741 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:10.739+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:10.739989+0000) 2020-02-12T17:13:10.742 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:13:10.739+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:10.740073+0000) 2020-02-12T17:13:10.742 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:13:10.739+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:10.740225+0000) 2020-02-12T17:13:10.742 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:13:10.739+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:10.740506+0000) 2020-02-12T17:13:10.744 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:13:10.738+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:10.740416+0000) 2020-02-12T17:13:10.745 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:13:10.739+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:10.740696+0000) 2020-02-12T17:13:10.745 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:13:10.739+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:10.740886+0000) 2020-02-12T17:13:10.745 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:13:10.739+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:10.741179+0000) 2020-02-12T17:13:10.746 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:13:10.739+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:10.741237+0000) 2020-02-12T17:13:10.746 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:13:10.740+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:10.741533+0000) 2020-02-12T17:13:10.746 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:13:10.740+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:10.740947+0000) 2020-02-12T17:13:10.746 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:10.740+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:10.741578+0000) 2020-02-12T17:13:10.747 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:13:10.741+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:10.742030+0000) 2020-02-12T17:13:10.747 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:13:10.744+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 56519 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:13:10.748 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:10.744+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:10.744731+0000) 2020-02-12T17:13:11.999 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:13:11.996+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:11.998073+0000) 2020-02-12T17:13:12.232 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:13:12.230+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:12.231372+0000) 2020-02-12T17:13:14.384 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:14.382+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:14.383107+0000) 2020-02-12T17:13:14.475 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:13:14.473+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:14.473586+0000) 2020-02-12T17:13:14.478 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:13:14.476+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:14.477491+0000) 2020-02-12T17:13:14.487 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:13:14.485+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:14.485840+0000) 2020-02-12T17:13:14.496 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:13:14.494+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:14.495035+0000) 2020-02-12T17:13:14.497 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:13:14.493+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:14.495231+0000) 2020-02-12T17:13:14.497 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:13:14.493+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:14.495245+0000) 2020-02-12T17:13:14.863 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:14.859+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:14.860146+0000) 2020-02-12T17:13:15.247 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:13:15.245+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:15.245954+0000) 2020-02-12T17:13:15.749 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:13:15.746+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:15.747925+0000) 2020-02-12T17:13:15.752 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:13:15.747+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:15.748147+0000) 2020-02-12T17:13:15.752 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:13:15.747+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:15.748268+0000) 2020-02-12T17:13:15.752 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:13:15.748+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:15.748632+0000) 2020-02-12T17:13:15.752 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:15.748+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:15.749019+0000) 2020-02-12T17:13:15.752 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:15.748+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:15.749495+0000) 2020-02-12T17:13:15.753 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:13:15.748+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:15.749226+0000) 2020-02-12T17:13:15.753 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:13:15.749+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:15.749888+0000) 2020-02-12T17:13:15.753 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:13:15.747+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:15.748454+0000) 2020-02-12T17:13:15.753 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:13:15.747+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:15.748864+0000) 2020-02-12T17:13:15.754 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:13:15.747+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:15.749100+0000) 2020-02-12T17:13:15.754 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:13:15.748+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:15.749685+0000) 2020-02-12T17:13:15.754 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:13:15.748+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:15.750182+0000) 2020-02-12T17:13:15.754 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:15.751+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:15.752554+0000) 2020-02-12T17:13:15.755 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:13:15.752+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 56566 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:13:15.927 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:15.925+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:15.926454+0000) 2020-02-12T17:13:17.742 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:13:17.739+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:17.740651+0000) 2020-02-12T17:13:17.988 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:13:17.986+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:17.987129+0000) 2020-02-12T17:13:20.756 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:13:20.753+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:20.755047+0000) 2020-02-12T17:13:20.757 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:13:20.753+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:20.755403+0000) 2020-02-12T17:13:20.757 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:13:20.754+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:20.755792+0000) 2020-02-12T17:13:20.757 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:13:20.754+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:20.756020+0000) 2020-02-12T17:13:20.757 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:13:20.754+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:20.756191+0000) 2020-02-12T17:13:20.759 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:13:20.755+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:20.756355+0000) 2020-02-12T17:13:20.759 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:13:20.755+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:20.756502+0000) 2020-02-12T17:13:20.759 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:13:20.756+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:20.756622+0000) 2020-02-12T17:13:20.759 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:20.756+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:20.756744+0000) 2020-02-12T17:13:20.759 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:20.756+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:20.757455+0000) 2020-02-12T17:13:20.759 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:13:20.756+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:20.756853+0000) 2020-02-12T17:13:20.760 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:13:20.756+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:20.757523+0000) 2020-02-12T17:13:20.760 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:13:20.755+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:20.757053+0000) 2020-02-12T17:13:20.761 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:20.759+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:20.760524+0000) 2020-02-12T17:13:20.762 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:13:20.759+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 56600 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:13:21.571 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:13:21.574 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:13:21.999 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:13:21.996+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:21.998242+0000) 2020-02-12T17:13:22.233 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:13:22.231+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:22.231567+0000) 2020-02-12T17:13:24.387 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:24.385+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:24.386163+0000) 2020-02-12T17:13:24.475 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:13:24.473+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:24.473759+0000) 2020-02-12T17:13:24.479 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:13:24.477+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:24.477681+0000) 2020-02-12T17:13:24.487 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:13:24.485+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:24.486029+0000) 2020-02-12T17:13:24.496 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:13:24.494+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:24.495182+0000) 2020-02-12T17:13:24.496 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:13:24.493+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:24.495398+0000) 2020-02-12T17:13:24.497 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:13:24.493+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:24.495395+0000) 2020-02-12T17:13:24.861 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:24.859+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:24.860336+0000) 2020-02-12T17:13:25.247 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:13:25.245+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:25.246151+0000) 2020-02-12T17:13:25.764 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:13:25.761+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:25.763384+0000) 2020-02-12T17:13:25.765 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:13:25.762+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:25.763578+0000) 2020-02-12T17:13:25.765 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:13:25.762+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:25.763725+0000) 2020-02-12T17:13:25.766 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:13:25.763+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:25.763963+0000) 2020-02-12T17:13:25.766 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:13:25.763+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:25.764326+0000) 2020-02-12T17:13:25.766 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:13:25.762+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:25.764193+0000) 2020-02-12T17:13:25.766 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:13:25.763+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:25.764750+0000) 2020-02-12T17:13:25.767 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:13:25.764+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:25.764991+0000) 2020-02-12T17:13:25.767 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:13:25.764+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:25.765319+0000) 2020-02-12T17:13:25.768 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:13:25.764+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:25.765436+0000) 2020-02-12T17:13:25.768 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:25.765+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:25.765596+0000) 2020-02-12T17:13:25.768 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:13:25.763+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:25.765250+0000) 2020-02-12T17:13:25.768 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:25.767+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:25.767640+0000) 2020-02-12T17:13:25.769 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:25.767+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:25.767823+0000) 2020-02-12T17:13:25.770 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:13:25.767+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 56647 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:13:25.928 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:25.926+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:25.926636+0000) 2020-02-12T17:13:27.742 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:13:27.740+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:27.740776+0000) 2020-02-12T17:13:27.988 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:13:27.986+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:27.987299+0000) 2020-02-12T17:13:30.777 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:13:30.770+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:30.771171+0000) 2020-02-12T17:13:30.777 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:13:30.771+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:30.771661+0000) 2020-02-12T17:13:30.778 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:13:30.771+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:30.771845+0000) 2020-02-12T17:13:30.778 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:13:30.771+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:30.772248+0000) 2020-02-12T17:13:30.778 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:30.771+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:30.772407+0000) 2020-02-12T17:13:30.778 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:30.772+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:30.772611+0000) 2020-02-12T17:13:30.778 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:30.775+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:30.775699+0000) 2020-02-12T17:13:30.778 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:13:30.772+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:30.772977+0000) 2020-02-12T17:13:30.779 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:13:30.769+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:30.770956+0000) 2020-02-12T17:13:30.779 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:13:30.770+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:30.771538+0000) 2020-02-12T17:13:30.779 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:13:30.769+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:30.771338+0000) 2020-02-12T17:13:30.779 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:13:30.770+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:30.772164+0000) 2020-02-12T17:13:30.780 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:13:30.771+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:30.772864+0000) 2020-02-12T17:13:30.780 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:13:30.771+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:30.773340+0000) 2020-02-12T17:13:30.780 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:13:30.775+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 56683 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:13:31.999 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:13:31.998+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:31.998442+0000) 2020-02-12T17:13:32.233 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:13:32.231+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:32.231756+0000) 2020-02-12T17:13:34.391 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:34.389+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:34.389263+0000) 2020-02-12T17:13:34.475 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:13:34.473+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:34.473884+0000) 2020-02-12T17:13:34.479 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:13:34.477+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:34.477880+0000) 2020-02-12T17:13:34.487 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:13:34.486+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:34.486197+0000) 2020-02-12T17:13:34.497 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:13:34.495+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:34.495346+0000) 2020-02-12T17:13:34.497 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:13:34.495+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:34.495553+0000) 2020-02-12T17:13:34.497 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:13:34.495+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:34.495553+0000) 2020-02-12T17:13:34.861 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:34.859+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:34.860542+0000) 2020-02-12T17:13:35.251 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:13:35.245+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:35.246351+0000) 2020-02-12T17:13:35.780 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:13:35.778+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:35.778476+0000) 2020-02-12T17:13:35.780 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:13:35.778+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:35.778649+0000) 2020-02-12T17:13:35.781 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:35.777+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:35.778941+0000) 2020-02-12T17:13:35.781 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:35.777+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:35.779188+0000) 2020-02-12T17:13:35.781 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:13:35.777+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:35.779444+0000) 2020-02-12T17:13:35.781 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:13:35.778+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:35.779395+0000) 2020-02-12T17:13:35.782 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:13:35.779+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:35.779605+0000) 2020-02-12T17:13:35.782 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:13:35.779+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:35.779833+0000) 2020-02-12T17:13:35.783 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:13:35.778+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:35.779861+0000) 2020-02-12T17:13:35.783 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:13:35.778+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:35.779996+0000) 2020-02-12T17:13:35.783 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:13:35.778+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:35.780109+0000) 2020-02-12T17:13:35.783 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:13:35.778+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:35.780210+0000) 2020-02-12T17:13:35.783 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:13:35.780+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:35.780622+0000) 2020-02-12T17:13:35.784 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:35.781+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:35.783387+0000) 2020-02-12T17:13:35.785 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:13:35.783+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 56730 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:13:35.928 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:35.925+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:35.926788+0000) 2020-02-12T17:13:37.742 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:13:37.740+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:37.740936+0000) 2020-02-12T17:13:37.989 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:13:37.985+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:37.987480+0000) 2020-02-12T17:13:40.787 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:13:40.784+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:40.786279+0000) 2020-02-12T17:13:40.788 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:40.784+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:40.786495+0000) 2020-02-12T17:13:40.788 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:13:40.784+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:40.786580+0000) 2020-02-12T17:13:40.789 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:13:40.786+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:40.786852+0000) 2020-02-12T17:13:40.789 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:13:40.786+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:40.786924+0000) 2020-02-12T17:13:40.789 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:13:40.786+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:40.787246+0000) 2020-02-12T17:13:40.790 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:13:40.786+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:40.787371+0000) 2020-02-12T17:13:40.790 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:13:40.787+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:40.787568+0000) 2020-02-12T17:13:40.790 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:13:40.787+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:40.788189+0000) 2020-02-12T17:13:40.791 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:13:40.786+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:40.787972+0000) 2020-02-12T17:13:40.791 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:40.786+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:40.788165+0000) 2020-02-12T17:13:40.791 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:13:40.786+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:40.788558+0000) 2020-02-12T17:13:40.791 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:13:40.787+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:40.788707+0000) 2020-02-12T17:13:40.792 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:40.789+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:40.790758+0000) 2020-02-12T17:13:40.792 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:13:40.791+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 56764 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:13:42.000 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:13:41.998+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:41.998637+0000) 2020-02-12T17:13:42.233 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:13:42.231+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:42.231948+0000) 2020-02-12T17:13:44.394 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:44.390+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:44.392540+0000) 2020-02-12T17:13:44.475 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:13:44.473+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:44.474109+0000) 2020-02-12T17:13:44.479 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:13:44.477+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:44.478084+0000) 2020-02-12T17:13:44.487 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:13:44.484+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:44.486400+0000) 2020-02-12T17:13:44.496 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:13:44.494+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:44.495537+0000) 2020-02-12T17:13:44.497 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:13:44.495+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:44.495765+0000) 2020-02-12T17:13:44.497 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:13:44.495+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:44.495741+0000) 2020-02-12T17:13:44.862 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:44.859+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:44.860734+0000) 2020-02-12T17:13:45.247 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:13:45.246+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:45.246548+0000) 2020-02-12T17:13:45.795 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:13:45.793+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:45.793469+0000) 2020-02-12T17:13:45.795 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:13:45.793+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:45.793696+0000) 2020-02-12T17:13:45.796 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:13:45.791+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:45.793540+0000) 2020-02-12T17:13:45.797 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:13:45.792+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:45.793896+0000) 2020-02-12T17:13:45.797 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:45.792+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:45.794054+0000) 2020-02-12T17:13:45.797 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:13:45.792+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:45.794249+0000) 2020-02-12T17:13:45.797 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:13:45.793+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:45.794822+0000) 2020-02-12T17:13:45.797 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:13:45.793+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:45.794131+0000) 2020-02-12T17:13:45.798 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:13:45.793+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:45.794376+0000) 2020-02-12T17:13:45.798 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:13:45.794+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:45.794705+0000) 2020-02-12T17:13:45.798 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:13:45.794+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:45.795003+0000) 2020-02-12T17:13:45.799 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:13:45.793+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:45.795341+0000) 2020-02-12T17:13:45.799 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:45.794+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:45.795731+0000) 2020-02-12T17:13:45.800 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:45.797+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:45.798843+0000) 2020-02-12T17:13:45.800 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:13:45.798+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 56811 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:13:45.928 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:45.925+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:45.926966+0000) 2020-02-12T17:13:47.742 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:13:47.741+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:47.741125+0000) 2020-02-12T17:13:47.989 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:13:47.986+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:47.987688+0000) 2020-02-12T17:13:50.802 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:13:50.800+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:50.800917+0000) 2020-02-12T17:13:50.802 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:13:50.800+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:50.801030+0000) 2020-02-12T17:13:50.802 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:13:50.800+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:50.801251+0000) 2020-02-12T17:13:50.804 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:13:50.799+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:50.801317+0000) 2020-02-12T17:13:50.804 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:13:50.800+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:50.802023+0000) 2020-02-12T17:13:50.804 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:50.800+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:50.802212+0000) 2020-02-12T17:13:50.804 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:50.800+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:50.802563+0000) 2020-02-12T17:13:50.804 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:13:50.801+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:50.801748+0000) 2020-02-12T17:13:50.804 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:13:50.801+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:50.801912+0000) 2020-02-12T17:13:50.805 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:13:50.802+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:50.802682+0000) 2020-02-12T17:13:50.805 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:13:50.801+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:50.802795+0000) 2020-02-12T17:13:50.806 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:13:50.801+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:50.803062+0000) 2020-02-12T17:13:50.806 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:13:50.801+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:50.803177+0000) 2020-02-12T17:13:50.808 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:13:50.806+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 56847 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:13:50.808 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:50.805+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:50.806981+0000) 2020-02-12T17:13:51.704 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:13:51.707 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:13:52.000 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:13:51.997+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:51.998866+0000) 2020-02-12T17:13:52.233 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:13:52.231+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:52.232159+0000) 2020-02-12T17:13:54.398 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:54.395+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:54.396563+0000) 2020-02-12T17:13:54.475 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:13:54.473+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:54.474305+0000) 2020-02-12T17:13:54.479 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:13:54.477+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:54.478315+0000) 2020-02-12T17:13:54.487 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:13:54.485+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:54.486531+0000) 2020-02-12T17:13:54.498 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:13:54.494+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:54.495961+0000) 2020-02-12T17:13:54.498 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:13:54.494+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:54.495961+0000) 2020-02-12T17:13:54.499 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:13:54.495+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:54.495761+0000) 2020-02-12T17:13:54.862 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:54.860+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:54.860895+0000) 2020-02-12T17:13:55.248 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:13:55.245+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:55.246775+0000) 2020-02-12T17:13:55.810 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:13:55.806+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:55.808328+0000) 2020-02-12T17:13:55.810 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:13:55.807+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:55.808566+0000) 2020-02-12T17:13:55.810 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:13:55.807+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:55.808816+0000) 2020-02-12T17:13:55.811 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:13:55.808+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:55.809035+0000) 2020-02-12T17:13:55.812 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:13:55.808+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:55.809212+0000) 2020-02-12T17:13:55.812 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:13:55.808+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:55.809450+0000) 2020-02-12T17:13:55.812 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:55.809+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:55.809711+0000) 2020-02-12T17:13:55.812 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:13:55.809+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:55.809775+0000) 2020-02-12T17:13:55.812 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:13:55.809+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:55.809999+0000) 2020-02-12T17:13:55.812 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:13:55.808+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:55.809443+0000) 2020-02-12T17:13:55.813 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:13:55.808+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:55.809596+0000) 2020-02-12T17:13:55.813 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:13:55.808+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:55.810278+0000) 2020-02-12T17:13:55.814 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:55.812+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:55.812847+0000) 2020-02-12T17:13:55.814 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:55.813+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:55.813643+0000) 2020-02-12T17:13:55.815 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:13:55.812+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 56894 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:13:55.933 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:13:55.926+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:55.927152+0000) 2020-02-12T17:13:57.742 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:13:57.740+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:57.741315+0000) 2020-02-12T17:13:57.989 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:13:57.987+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:13:57.987821+0000) 2020-02-12T17:14:00.820 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:14:00.815+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:00.816404+0000) 2020-02-12T17:14:00.821 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:00.816+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:00.816677+0000) 2020-02-12T17:14:00.886 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:14:00.816+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:00.817043+0000) 2020-02-12T17:14:00.887 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:14:00.816+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:00.817439+0000) 2020-02-12T17:14:00.887 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:14:00.817+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:00.817639+0000) 2020-02-12T17:14:00.887 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:14:00.817+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:00.817781+0000) 2020-02-12T17:14:00.887 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:14:00.814+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:00.815992+0000) 2020-02-12T17:14:00.888 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:14:00.814+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:00.816183+0000) 2020-02-12T17:14:00.888 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:14:00.815+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:00.816725+0000) 2020-02-12T17:14:00.888 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:14:00.815+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:00.816927+0000) 2020-02-12T17:14:00.888 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:14:00.816+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:00.817861+0000) 2020-02-12T17:14:00.888 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:14:00.816+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:00.818291+0000) 2020-02-12T17:14:00.889 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:00.817+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:00.818069+0000) 2020-02-12T17:14:00.889 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:00.819+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:00.819869+0000) 2020-02-12T17:14:00.889 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:14:00.820+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 56928 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:14:02.000 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:14:01.997+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:01.999149+0000) 2020-02-12T17:14:02.235 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:14:02.231+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:02.232356+0000) 2020-02-12T17:14:04.401 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:04.399+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:04.399641+0000) 2020-02-12T17:14:04.475 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:14:04.474+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:04.474497+0000) 2020-02-12T17:14:04.479 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:14:04.477+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:04.478537+0000) 2020-02-12T17:14:04.487 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:14:04.486+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:04.486664+0000) 2020-02-12T17:14:04.497 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:14:04.495+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:04.495897+0000) 2020-02-12T17:14:04.497 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:14:04.494+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:04.496138+0000) 2020-02-12T17:14:04.497 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:14:04.494+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:04.496135+0000) 2020-02-12T17:14:04.862 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:04.860+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:04.861077+0000) 2020-02-12T17:14:05.248 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:14:05.246+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:05.246967+0000) 2020-02-12T17:14:05.825 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:14:05.823+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:05.823638+0000) 2020-02-12T17:14:05.825 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:05.823+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:05.824021+0000) 2020-02-12T17:14:05.828 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:14:05.822+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:05.824179+0000) 2020-02-12T17:14:05.828 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:14:05.822+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:05.824388+0000) 2020-02-12T17:14:05.829 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:14:05.823+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:05.824772+0000) 2020-02-12T17:14:05.829 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:14:05.823+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:05.824943+0000) 2020-02-12T17:14:05.829 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:14:05.823+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:05.825268+0000) 2020-02-12T17:14:05.829 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:14:05.823+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:05.825259+0000) 2020-02-12T17:14:05.830 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:14:05.823+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:05.824243+0000) 2020-02-12T17:14:05.830 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:14:05.823+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:05.824508+0000) 2020-02-12T17:14:05.831 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:14:05.824+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:05.825392+0000) 2020-02-12T17:14:05.831 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:05.824+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:05.825545+0000) 2020-02-12T17:14:05.831 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:14:05.825+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:05.825782+0000) 2020-02-12T17:14:05.832 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:14:05.828+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 56975 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:14:05.832 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:05.828+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:05.829313+0000) 2020-02-12T17:14:05.928 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:05.926+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:05.927333+0000) 2020-02-12T17:14:07.743 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:14:07.740+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:07.741538+0000) 2020-02-12T17:14:07.989 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:14:07.987+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:07.987977+0000) 2020-02-12T17:14:10.833 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:14:10.831+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:10.831629+0000) 2020-02-12T17:14:10.834 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:14:10.830+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:10.831754+0000) 2020-02-12T17:14:10.834 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:14:10.831+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:10.832458+0000) 2020-02-12T17:14:10.834 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:14:10.831+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:10.832642+0000) 2020-02-12T17:14:10.835 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:10.831+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:10.832062+0000) 2020-02-12T17:14:10.835 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:14:10.831+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:10.832124+0000) 2020-02-12T17:14:10.835 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:14:10.831+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:10.832311+0000) 2020-02-12T17:14:10.835 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:14:10.832+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:10.833121+0000) 2020-02-12T17:14:10.836 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:14:10.831+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:10.832878+0000) 2020-02-12T17:14:10.836 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:14:10.831+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:10.833346+0000) 2020-02-12T17:14:10.836 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:14:10.831+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:10.833412+0000) 2020-02-12T17:14:10.836 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:14:10.832+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:10.833562+0000) 2020-02-12T17:14:10.837 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:10.835+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:10.835785+0000) 2020-02-12T17:14:10.838 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:10.835+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:10.836008+0000) 2020-02-12T17:14:10.838 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:14:10.835+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 57011 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:14:12.000 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:14:11.998+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:11.999340+0000) 2020-02-12T17:14:12.234 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:14:12.232+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:12.232582+0000) 2020-02-12T17:14:14.404 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:14.402+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:14.402643+0000) 2020-02-12T17:14:14.476 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:14:14.474+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:14.474674+0000) 2020-02-12T17:14:14.480 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:14:14.478+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:14.478726+0000) 2020-02-12T17:14:14.488 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:14:14.486+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:14.486842+0000) 2020-02-12T17:14:14.499 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:14:14.495+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:14.496336+0000) 2020-02-12T17:14:14.499 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:14:14.495+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:14.496325+0000) 2020-02-12T17:14:14.499 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:14:14.495+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:14.496056+0000) 2020-02-12T17:14:14.862 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:14.861+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:14.861235+0000) 2020-02-12T17:14:15.248 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:14:15.245+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:15.247172+0000) 2020-02-12T17:14:15.840 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:14:15.837+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:15.839031+0000) 2020-02-12T17:14:15.840 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:14:15.837+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:15.839215+0000) 2020-02-12T17:14:15.841 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:14:15.839+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:15.839923+0000) 2020-02-12T17:14:15.841 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:14:15.838+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:15.839530+0000) 2020-02-12T17:14:15.841 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:14:15.838+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:15.839837+0000) 2020-02-12T17:14:15.842 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:14:15.838+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:15.840128+0000) 2020-02-12T17:14:15.843 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:15.839+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:15.840276+0000) 2020-02-12T17:14:15.843 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:15.840+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:15.840659+0000) 2020-02-12T17:14:15.843 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:14:15.839+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:15.840378+0000) 2020-02-12T17:14:15.843 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:14:15.839+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:15.840476+0000) 2020-02-12T17:14:15.843 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:14:15.840+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:15.840906+0000) 2020-02-12T17:14:15.844 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:14:15.840+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:15.841034+0000) 2020-02-12T17:14:15.844 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:14:15.839+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:15.840682+0000) 2020-02-12T17:14:15.845 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:15.843+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:15.844269+0000) 2020-02-12T17:14:15.846 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:14:15.843+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 57058 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:14:15.929 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:15.927+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:15.927521+0000) 2020-02-12T17:14:17.743 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:14:17.741+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:17.741732+0000) 2020-02-12T17:14:17.989 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:14:17.988+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:17.988185+0000) 2020-02-12T17:14:20.849 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:20.846+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:20.846824+0000) 2020-02-12T17:14:20.849 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:20.846+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:20.846933+0000) 2020-02-12T17:14:20.849 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:14:20.847+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:20.847708+0000) 2020-02-12T17:14:20.850 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:14:20.846+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:20.846567+0000) 2020-02-12T17:14:20.850 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:14:20.846+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:20.847210+0000) 2020-02-12T17:14:20.850 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:14:20.846+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:20.847185+0000) 2020-02-12T17:14:20.850 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:14:20.847+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:20.847422+0000) 2020-02-12T17:14:20.850 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:14:20.847+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:20.847568+0000) 2020-02-12T17:14:20.851 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:14:20.847+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:20.848149+0000) 2020-02-12T17:14:20.851 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:14:20.847+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:20.847970+0000) 2020-02-12T17:14:20.851 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:14:20.847+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:20.848442+0000) 2020-02-12T17:14:20.852 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:14:20.848+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:20.848618+0000) 2020-02-12T17:14:20.852 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:14:20.848+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:20.848717+0000) 2020-02-12T17:14:20.852 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:20.850+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:20.850981+0000) 2020-02-12T17:14:20.858 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:14:20.852+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 57092 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:14:21.852 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:14:21.855 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:14:22.000 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:14:21.999+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:21.999534+0000) 2020-02-12T17:14:22.234 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:14:22.231+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:22.232822+0000) 2020-02-12T17:14:24.407 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:24.404+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:24.405896+0000) 2020-02-12T17:14:24.476 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:14:24.473+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:24.474846+0000) 2020-02-12T17:14:24.480 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:14:24.478+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:24.478923+0000) 2020-02-12T17:14:24.488 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:14:24.486+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:24.486993+0000) 2020-02-12T17:14:24.497 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:14:24.495+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:24.496251+0000) 2020-02-12T17:14:24.498 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:14:24.496+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:24.496498+0000) 2020-02-12T17:14:24.498 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:14:24.496+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:24.496492+0000) 2020-02-12T17:14:24.862 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:24.860+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:24.861402+0000) 2020-02-12T17:14:25.248 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:14:25.247+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:25.247354+0000) 2020-02-12T17:14:25.855 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:25.852+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:25.854224+0000) 2020-02-12T17:14:25.855 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:25.852+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:25.854412+0000) 2020-02-12T17:14:25.856 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:14:25.853+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:25.854612+0000) 2020-02-12T17:14:25.857 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:14:25.854+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:25.854512+0000) 2020-02-12T17:14:25.857 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:14:25.854+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:25.854779+0000) 2020-02-12T17:14:25.857 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:14:25.854+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:25.854961+0000) 2020-02-12T17:14:25.858 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:14:25.854+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:25.855269+0000) 2020-02-12T17:14:25.858 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:14:25.855+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:25.855582+0000) 2020-02-12T17:14:25.858 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:14:25.855+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:25.855651+0000) 2020-02-12T17:14:25.858 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:14:25.853+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:25.855324+0000) 2020-02-12T17:14:25.858 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:14:25.854+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:25.855761+0000) 2020-02-12T17:14:25.859 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:14:25.854+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:25.856052+0000) 2020-02-12T17:14:25.859 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:14:25.854+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:25.856339+0000) 2020-02-12T17:14:25.860 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:25.857+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:25.858867+0000) 2020-02-12T17:14:25.861 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:14:25.859+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 57139 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:14:25.929 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:25.926+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:25.927692+0000) 2020-02-12T17:14:27.743 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:14:27.741+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:27.741979+0000) 2020-02-12T17:14:27.989 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:14:27.987+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:27.988400+0000) 2020-02-12T17:14:30.862 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:14:30.860+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:30.860995+0000) 2020-02-12T17:14:30.863 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:14:30.860+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:30.861391+0000) 2020-02-12T17:14:30.864 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:14:30.860+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:30.861643+0000) 2020-02-12T17:14:30.864 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:14:30.860+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:30.861984+0000) 2020-02-12T17:14:30.865 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:14:30.860+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:30.862199+0000) 2020-02-12T17:14:30.865 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:14:30.860+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:30.862536+0000) 2020-02-12T17:14:30.865 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:30.861+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:30.862713+0000) 2020-02-12T17:14:30.865 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:30.861+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:30.863011+0000) 2020-02-12T17:14:30.865 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:14:30.861+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:30.861928+0000) 2020-02-12T17:14:30.865 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:14:30.862+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:30.863064+0000) 2020-02-12T17:14:30.866 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:14:30.862+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:30.863223+0000) 2020-02-12T17:14:30.866 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:14:30.863+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:30.863444+0000) 2020-02-12T17:14:30.866 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:14:30.862+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:30.863762+0000) 2020-02-12T17:14:30.866 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:30.863+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:30.865579+0000) 2020-02-12T17:14:30.868 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:14:30.866+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 57175 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:14:32.001 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:14:31.999+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:31.999719+0000) 2020-02-12T17:14:32.234 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:14:32.231+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:32.233016+0000) 2020-02-12T17:14:34.410 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:34.407+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:34.409133+0000) 2020-02-12T17:14:34.476 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:14:34.474+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:34.475028+0000) 2020-02-12T17:14:34.480 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:14:34.478+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:34.479078+0000) 2020-02-12T17:14:34.488 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:14:34.486+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:34.487148+0000) 2020-02-12T17:14:34.497 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:14:34.495+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:34.496438+0000) 2020-02-12T17:14:34.498 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:14:34.496+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:34.496671+0000) 2020-02-12T17:14:34.498 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:14:34.496+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:34.496679+0000) 2020-02-12T17:14:34.863 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:34.860+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:34.861568+0000) 2020-02-12T17:14:35.249 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:14:35.247+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:35.247536+0000) 2020-02-12T17:14:35.870 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:14:35.868+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:35.868881+0000) 2020-02-12T17:14:35.870 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:14:35.868+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:35.869202+0000) 2020-02-12T17:14:35.871 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:14:35.868+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:35.870055+0000) 2020-02-12T17:14:35.871 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:14:35.869+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:35.869493+0000) 2020-02-12T17:14:35.871 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:14:35.869+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:35.869572+0000) 2020-02-12T17:14:35.873 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:35.868+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:35.870328+0000) 2020-02-12T17:14:35.873 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:35.868+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:35.870456+0000) 2020-02-12T17:14:35.873 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:14:35.868+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:35.870516+0000) 2020-02-12T17:14:35.873 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:14:35.869+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:35.870822+0000) 2020-02-12T17:14:35.873 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:14:35.869+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:35.871064+0000) 2020-02-12T17:14:35.874 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:14:35.869+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:35.871132+0000) 2020-02-12T17:14:35.874 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:14:35.870+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:35.870689+0000) 2020-02-12T17:14:35.874 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:14:35.870+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:35.871335+0000) 2020-02-12T17:14:35.875 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:14:35.874+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 57222 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:14:35.876 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:35.873+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:35.875385+0000) 2020-02-12T17:14:35.929 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:35.927+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:35.927900+0000) 2020-02-12T17:14:37.746 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:14:37.742+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:37.742201+0000) 2020-02-12T17:14:37.990 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:14:37.987+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:37.988613+0000) 2020-02-12T17:14:40.877 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:14:40.874+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:40.876347+0000) 2020-02-12T17:14:40.879 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:40.876+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:40.876721+0000) 2020-02-12T17:14:40.879 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:40.876+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:40.876814+0000) 2020-02-12T17:14:40.879 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:14:40.876+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:40.877183+0000) 2020-02-12T17:14:40.879 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:14:40.876+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:40.877297+0000) 2020-02-12T17:14:40.879 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:14:40.876+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:40.877442+0000) 2020-02-12T17:14:40.880 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:14:40.875+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:40.876925+0000) 2020-02-12T17:14:40.880 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:14:40.875+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:40.877133+0000) 2020-02-12T17:14:40.880 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:14:40.876+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:40.877621+0000) 2020-02-12T17:14:40.881 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:14:40.877+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:40.877685+0000) 2020-02-12T17:14:40.881 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:14:40.877+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:40.878268+0000) 2020-02-12T17:14:40.881 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:14:40.876+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:40.878192+0000) 2020-02-12T17:14:40.881 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:14:40.877+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:40.879023+0000) 2020-02-12T17:14:40.882 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:40.880+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:40.881302+0000) 2020-02-12T17:14:40.884 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:14:40.880+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 57256 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:14:42.001 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:14:41.998+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:41.999906+0000) 2020-02-12T17:14:42.234 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:14:42.232+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:42.233157+0000) 2020-02-12T17:14:44.414 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:44.411+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:44.412463+0000) 2020-02-12T17:14:44.476 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:14:44.474+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:44.475224+0000) 2020-02-12T17:14:44.480 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:14:44.478+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:44.479304+0000) 2020-02-12T17:14:44.488 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:14:44.486+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:44.487327+0000) 2020-02-12T17:14:44.497 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:14:44.496+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:44.496594+0000) 2020-02-12T17:14:44.498 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:14:44.495+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:44.496779+0000) 2020-02-12T17:14:44.498 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:14:44.495+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:44.496774+0000) 2020-02-12T17:14:44.863 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:44.861+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:44.861800+0000) 2020-02-12T17:14:45.249 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:14:45.246+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:45.247726+0000) 2020-02-12T17:14:45.885 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:45.883+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:45.884401+0000) 2020-02-12T17:14:45.886 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:14:45.883+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:45.884469+0000) 2020-02-12T17:14:45.887 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:14:45.883+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:45.884705+0000) 2020-02-12T17:14:45.887 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:14:45.883+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:45.884986+0000) 2020-02-12T17:14:45.887 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:14:45.883+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:45.885193+0000) 2020-02-12T17:14:45.888 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:14:45.884+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:45.885620+0000) 2020-02-12T17:14:45.888 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:45.884+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:45.885085+0000) 2020-02-12T17:14:45.888 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:14:45.884+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:45.885485+0000) 2020-02-12T17:14:45.889 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:14:45.885+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:45.885781+0000) 2020-02-12T17:14:45.890 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:14:45.884+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:45.885930+0000) 2020-02-12T17:14:45.890 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:14:45.884+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:45.886210+0000) 2020-02-12T17:14:45.890 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:14:45.885+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:45.886483+0000) 2020-02-12T17:14:45.890 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:14:45.886+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:45.886617+0000) 2020-02-12T17:14:45.891 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:14:45.888+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 57303 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:14:45.891 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:45.889+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:45.890122+0000) 2020-02-12T17:14:45.929 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:45.927+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:45.928070+0000) 2020-02-12T17:14:47.743 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:14:47.741+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:47.742359+0000) 2020-02-12T17:14:47.990 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:14:47.988+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:47.988790+0000) 2020-02-12T17:14:50.893 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:14:50.890+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:50.891548+0000) 2020-02-12T17:14:50.894 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:50.891+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:50.891720+0000) 2020-02-12T17:14:50.894 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:50.891+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:50.891931+0000) 2020-02-12T17:14:50.894 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:14:50.891+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:50.892039+0000) 2020-02-12T17:14:50.894 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:14:50.891+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:50.892298+0000) 2020-02-12T17:14:50.895 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:14:50.890+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:50.892301+0000) 2020-02-12T17:14:50.895 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:14:50.891+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:50.892461+0000) 2020-02-12T17:14:50.895 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:14:50.891+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:50.892667+0000) 2020-02-12T17:14:50.895 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:14:50.891+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:50.892870+0000) 2020-02-12T17:14:50.895 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:14:50.891+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:50.893137+0000) 2020-02-12T17:14:50.896 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:14:50.892+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:50.893354+0000) 2020-02-12T17:14:50.896 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:14:50.893+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:50.893695+0000) 2020-02-12T17:14:50.896 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:14:50.893+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:50.893737+0000) 2020-02-12T17:14:50.897 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:50.895+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:50.896260+0000) 2020-02-12T17:14:50.898 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:14:50.895+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 57339 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:14:51.999 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:14:52.006 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:14:51.998+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:52.000105+0000) 2020-02-12T17:14:52.008 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:14:52.234 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:14:52.232+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:52.233337+0000) 2020-02-12T17:14:54.417 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:54.415+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:54.415621+0000) 2020-02-12T17:14:54.476 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:14:54.475+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:54.475421+0000) 2020-02-12T17:14:54.480 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:14:54.478+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:54.479498+0000) 2020-02-12T17:14:54.488 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:14:54.487+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:54.487516+0000) 2020-02-12T17:14:54.498 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:14:54.496+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:54.496761+0000) 2020-02-12T17:14:54.498 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:14:54.496+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:54.496945+0000) 2020-02-12T17:14:54.499 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:14:54.496+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:54.496945+0000) 2020-02-12T17:14:54.863 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:54.861+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:54.862012+0000) 2020-02-12T17:14:55.249 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:14:55.246+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:55.247987+0000) 2020-02-12T17:14:55.900 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:14:55.897+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:55.898964+0000) 2020-02-12T17:14:55.901 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:14:55.897+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:55.899283+0000) 2020-02-12T17:14:55.903 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:14:55.898+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:55.899392+0000) 2020-02-12T17:14:55.903 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:14:55.898+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:55.899560+0000) 2020-02-12T17:14:55.904 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:14:55.899+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:55.900368+0000) 2020-02-12T17:14:55.904 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:55.900+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:55.900616+0000) 2020-02-12T17:14:55.904 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:55.900+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:55.900838+0000) 2020-02-12T17:14:55.905 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:14:55.900+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:55.901004+0000) 2020-02-12T17:14:55.905 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:14:55.900+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:55.901150+0000) 2020-02-12T17:14:55.906 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:14:55.898+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:55.899751+0000) 2020-02-12T17:14:55.906 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:14:55.898+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:55.899911+0000) 2020-02-12T17:14:55.906 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:14:55.898+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:55.899969+0000) 2020-02-12T17:14:55.908 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:14:55.898+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:55.900250+0000) 2020-02-12T17:14:55.909 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:55.903+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:55.903889+0000) 2020-02-12T17:14:55.909 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:14:55.903+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 57384 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:14:55.929 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:14:55.928+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:55.928286+0000) 2020-02-12T17:14:57.743 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:14:57.741+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:57.742551+0000) 2020-02-12T17:14:57.990 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:14:57.988+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:14:57.989019+0000) 2020-02-12T17:15:00.908 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:15:00.905+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:00.906768+0000) 2020-02-12T17:15:00.908 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:15:00.905+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:00.907080+0000) 2020-02-12T17:15:00.909 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:15:00.906+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:00.907553+0000) 2020-02-12T17:15:00.910 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:00.907+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:00.907720+0000) 2020-02-12T17:15:00.910 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:15:00.906+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:00.907766+0000) 2020-02-12T17:15:00.910 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:15:00.906+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:00.908014+0000) 2020-02-12T17:15:00.910 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:15:00.906+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:00.907954+0000) 2020-02-12T17:15:00.910 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:15:00.906+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:00.908290+0000) 2020-02-12T17:15:00.911 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:15:00.907+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:00.908296+0000) 2020-02-12T17:15:00.911 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:15:00.907+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:00.908415+0000) 2020-02-12T17:15:00.911 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:15:00.907+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:00.908558+0000) 2020-02-12T17:15:00.912 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:15:00.908+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:00.908878+0000) 2020-02-12T17:15:00.913 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:00.911+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:00.912015+0000) 2020-02-12T17:15:00.913 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:00.911+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:00.912205+0000) 2020-02-12T17:15:00.914 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:15:00.911+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 57420 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:15:02.010 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:15:01.999+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:02.000293+0000) 2020-02-12T17:15:02.234 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:15:02.233+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:02.233540+0000) 2020-02-12T17:15:04.420 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:04.418+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:04.418845+0000) 2020-02-12T17:15:04.477 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:15:04.475+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:04.475620+0000) 2020-02-12T17:15:04.481 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:15:04.479+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:04.479692+0000) 2020-02-12T17:15:04.489 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:15:04.487+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:04.487706+0000) 2020-02-12T17:15:04.498 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:15:04.496+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:04.496977+0000) 2020-02-12T17:15:04.499 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:15:04.496+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:04.497138+0000) 2020-02-12T17:15:04.499 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:15:04.496+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:04.497162+0000) 2020-02-12T17:15:04.863 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:04.861+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:04.862221+0000) 2020-02-12T17:15:05.249 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:15:05.247+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:05.248211+0000) 2020-02-12T17:15:05.919 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:05.914+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:05.915243+0000) 2020-02-12T17:15:05.919 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:05.915+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:05.916538+0000) 2020-02-12T17:15:05.920 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:15:05.914+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:05.915481+0000) 2020-02-12T17:15:05.920 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:15:05.915+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:05.915852+0000) 2020-02-12T17:15:05.920 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:15:05.915+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:05.916112+0000) 2020-02-12T17:15:05.920 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:15:05.915+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:05.916258+0000) 2020-02-12T17:15:05.920 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:15:05.915+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:05.916380+0000) 2020-02-12T17:15:05.921 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:15:05.914+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:05.914581+0000) 2020-02-12T17:15:05.921 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:15:05.914+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:05.914771+0000) 2020-02-12T17:15:05.921 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:15:05.914+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:05.915318+0000) 2020-02-12T17:15:05.921 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:15:05.915+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:05.915602+0000) 2020-02-12T17:15:05.921 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:15:05.915+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:05.915739+0000) 2020-02-12T17:15:05.921 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:15:05.915+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:05.916043+0000) 2020-02-12T17:15:05.922 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:05.919+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:05.919719+0000) 2020-02-12T17:15:05.922 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:15:05.919+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 57465 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:15:05.929 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:05.927+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:05.928410+0000) 2020-02-12T17:15:07.748 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:15:07.742+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:07.742706+0000) 2020-02-12T17:15:08.202 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:15:07.988+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:07.989212+0000) 2020-02-12T17:15:10.923 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:15:10.920+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:10.921959+0000) 2020-02-12T17:15:10.923 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:15:10.920+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:10.922278+0000) 2020-02-12T17:15:10.926 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:15:10.922+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:10.922737+0000) 2020-02-12T17:15:10.926 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:15:10.922+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:10.923096+0000) 2020-02-12T17:15:10.927 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:15:10.922+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:10.923212+0000) 2020-02-12T17:15:10.927 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:15:10.923+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:10.923506+0000) 2020-02-12T17:15:10.927 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:15:10.923+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:10.923930+0000) 2020-02-12T17:15:10.927 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:15:10.923+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:10.924325+0000) 2020-02-12T17:15:10.929 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:10.921+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:10.922917+0000) 2020-02-12T17:15:10.929 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:10.921+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:10.923351+0000) 2020-02-12T17:15:10.930 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:15:10.921+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:10.922955+0000) 2020-02-12T17:15:10.930 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:15:10.922+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:10.923642+0000) 2020-02-12T17:15:10.931 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:15:10.922+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:10.923816+0000) 2020-02-12T17:15:10.933 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:15:10.927+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 57503 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:15:10.934 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:10.925+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:10.927202+0000) 2020-02-12T17:15:12.002 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:15:12.000+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:12.000487+0000) 2020-02-12T17:15:12.235 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:15:12.232+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:12.233771+0000) 2020-02-12T17:15:14.426 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:14.421+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:14.422026+0000) 2020-02-12T17:15:14.477 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:15:14.474+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:14.475780+0000) 2020-02-12T17:15:14.481 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:15:14.479+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:14.479885+0000) 2020-02-12T17:15:14.489 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:15:14.487+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:14.487897+0000) 2020-02-12T17:15:14.502 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:15:14.496+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:14.497276+0000) 2020-02-12T17:15:14.503 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:15:14.496+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:14.497311+0000) 2020-02-12T17:15:14.503 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:15:14.495+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:14.497114+0000) 2020-02-12T17:15:14.866 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:14.861+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:14.862420+0000) 2020-02-12T17:15:15.249 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:15:15.248+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:15.248454+0000) 2020-02-12T17:15:15.933 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:15:15.929+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:15.929566+0000) 2020-02-12T17:15:15.933 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:15:15.929+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:15.929898+0000) 2020-02-12T17:15:15.933 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:15:15.930+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:15.930467+0000) 2020-02-12T17:15:15.934 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:15:15.930+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:15.930992+0000) 2020-02-12T17:15:15.934 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:15.927+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:15.928553+0000) 2020-02-12T17:15:15.934 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:15.928+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:15.930422+0000) 2020-02-12T17:15:15.934 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:15.929+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:15.931316+0000) 2020-02-12T17:15:15.934 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:15:15.928+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:15.930234+0000) 2020-02-12T17:15:15.934 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:15:15.929+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:15.930610+0000) 2020-02-12T17:15:15.935 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:15:15.929+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:15.930871+0000) 2020-02-12T17:15:15.935 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:15:15.929+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:15.931102+0000) 2020-02-12T17:15:15.935 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:15:15.929+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:15.931366+0000) 2020-02-12T17:15:15.936 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:15:15.931+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:15.931571+0000) 2020-02-12T17:15:15.936 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:15:15.931+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:15.931582+0000) 2020-02-12T17:15:15.936 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:15.933+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:15.934735+0000) 2020-02-12T17:15:15.937 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:15:15.935+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 57548 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:15:17.744 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:15:17.742+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:17.742910+0000) 2020-02-12T17:15:17.990 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:15:17.987+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:17.989425+0000) 2020-02-12T17:15:20.938 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:15:20.936+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:20.937189+0000) 2020-02-12T17:15:20.938 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:15:20.936+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:20.937419+0000) 2020-02-12T17:15:20.939 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:15:20.936+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:20.937877+0000) 2020-02-12T17:15:20.939 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:15:20.937+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:20.938003+0000) 2020-02-12T17:15:20.940 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:15:20.937+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:20.938132+0000) 2020-02-12T17:15:20.940 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:15:20.938+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:20.938474+0000) 2020-02-12T17:15:20.941 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:15:20.937+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:20.938623+0000) 2020-02-12T17:15:20.941 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:15:20.937+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:20.938879+0000) 2020-02-12T17:15:20.941 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:20.937+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:20.939067+0000) 2020-02-12T17:15:20.942 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:20.937+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:20.939441+0000) 2020-02-12T17:15:20.942 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:15:20.937+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:20.939310+0000) 2020-02-12T17:15:20.942 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:15:20.938+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:20.939709+0000) 2020-02-12T17:15:20.943 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:15:20.939+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:20.939731+0000) 2020-02-12T17:15:20.943 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:20.941+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:20.942811+0000) 2020-02-12T17:15:20.945 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:15:20.943+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 57584 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:15:22.002 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:15:22.000+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:22.000685+0000) 2020-02-12T17:15:22.153 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:15:22.156 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:15:22.235 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:15:22.233+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:22.233955+0000) 2020-02-12T17:15:24.427 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:24.425+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:24.425795+0000) 2020-02-12T17:15:24.478 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:15:24.475+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:24.476001+0000) 2020-02-12T17:15:24.482 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:15:24.480+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:24.480081+0000) 2020-02-12T17:15:24.489 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:15:24.487+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:24.488076+0000) 2020-02-12T17:15:24.498 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:15:24.496+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:24.497247+0000) 2020-02-12T17:15:24.499 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:15:24.497+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:24.497477+0000) 2020-02-12T17:15:24.499 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:15:24.497+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:24.497423+0000) 2020-02-12T17:15:24.864 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:24.861+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:24.862636+0000) 2020-02-12T17:15:25.250 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:15:25.248+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:25.248677+0000) 2020-02-12T17:15:25.930 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:25.928+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:25.928716+0000) 2020-02-12T17:15:25.946 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:15:25.944+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:25.945695+0000) 2020-02-12T17:15:25.947 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:15:25.945+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:25.946149+0000) 2020-02-12T17:15:25.948 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:15:25.944+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:25.946031+0000) 2020-02-12T17:15:25.948 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:15:25.944+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:25.945819+0000) 2020-02-12T17:15:25.948 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:15:25.944+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:25.946304+0000) 2020-02-12T17:15:25.948 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:15:25.945+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:25.946789+0000) 2020-02-12T17:15:25.949 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:25.945+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:25.946517+0000) 2020-02-12T17:15:25.949 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:25.946+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:25.946847+0000) 2020-02-12T17:15:25.950 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:15:25.946+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:25.947092+0000) 2020-02-12T17:15:25.950 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:15:25.946+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:25.947201+0000) 2020-02-12T17:15:25.950 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:15:25.946+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:25.947437+0000) 2020-02-12T17:15:25.950 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:15:25.947+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:25.947876+0000) 2020-02-12T17:15:25.950 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:15:25.946+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:25.947749+0000) 2020-02-12T17:15:25.951 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:25.950+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:25.950696+0000) 2020-02-12T17:15:25.952 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:15:25.950+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 57629 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:15:27.744 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:15:27.742+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:27.743126+0000) 2020-02-12T17:15:27.991 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:15:27.989+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:27.989628+0000) 2020-02-12T17:15:30.954 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:30.952+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:30.953337+0000) 2020-02-12T17:15:30.955 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:30.953+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:30.953616+0000) 2020-02-12T17:15:30.955 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:15:30.952+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:30.953469+0000) 2020-02-12T17:15:30.956 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:15:30.952+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:30.953894+0000) 2020-02-12T17:15:30.956 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:15:30.952+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:30.954386+0000) 2020-02-12T17:15:30.956 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:15:30.953+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:30.954051+0000) 2020-02-12T17:15:30.956 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:15:30.953+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:30.954396+0000) 2020-02-12T17:15:30.956 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:15:30.953+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:30.954523+0000) 2020-02-12T17:15:30.957 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:15:30.953+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:30.954713+0000) 2020-02-12T17:15:30.957 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:15:30.953+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:30.954833+0000) 2020-02-12T17:15:30.958 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:15:30.953+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:30.955109+0000) 2020-02-12T17:15:30.958 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:15:30.954+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:30.955243+0000) 2020-02-12T17:15:30.958 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:15:30.955+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:30.955738+0000) 2020-02-12T17:15:30.959 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:30.957+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:30.958140+0000) 2020-02-12T17:15:30.960 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:15:30.958+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 57667 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:15:32.002 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:15:31.999+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:32.000876+0000) 2020-02-12T17:15:32.235 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:15:32.233+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:32.234163+0000) 2020-02-12T17:15:34.430 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:34.428+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:34.428952+0000) 2020-02-12T17:15:34.477 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:15:34.475+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:34.476254+0000) 2020-02-12T17:15:34.481 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:15:34.479+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:34.480276+0000) 2020-02-12T17:15:34.489 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:15:34.487+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:34.488241+0000) 2020-02-12T17:15:34.498 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:15:34.496+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:34.497430+0000) 2020-02-12T17:15:34.499 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:15:34.496+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:34.497666+0000) 2020-02-12T17:15:34.499 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:15:34.496+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:34.497646+0000) 2020-02-12T17:15:34.864 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:34.862+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:34.862772+0000) 2020-02-12T17:15:35.250 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:15:35.248+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:35.248875+0000) 2020-02-12T17:15:35.930 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:35.928+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:35.928867+0000) 2020-02-12T17:15:35.962 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:35.960+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:35.961459+0000) 2020-02-12T17:15:35.963 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:15:35.960+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:35.961621+0000) 2020-02-12T17:15:35.964 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:35.961+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:35.962087+0000) 2020-02-12T17:15:35.964 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:15:35.961+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:35.962350+0000) 2020-02-12T17:15:35.964 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:15:35.961+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:35.962503+0000) 2020-02-12T17:15:35.964 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:15:35.960+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:35.962215+0000) 2020-02-12T17:15:35.965 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:15:35.961+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:35.962762+0000) 2020-02-12T17:15:35.965 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:15:35.961+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:35.962911+0000) 2020-02-12T17:15:35.965 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:15:35.961+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:35.962744+0000) 2020-02-12T17:15:35.966 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:15:35.962+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:35.963021+0000) 2020-02-12T17:15:35.966 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:15:35.962+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:35.963182+0000) 2020-02-12T17:15:35.966 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:15:35.963+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:35.963688+0000) 2020-02-12T17:15:35.966 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:15:35.962+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:35.963599+0000) 2020-02-12T17:15:35.967 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:35.965+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:35.966334+0000) 2020-02-12T17:15:35.968 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:15:35.965+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 57712 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:15:37.744 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:15:37.742+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:37.743322+0000) 2020-02-12T17:15:37.991 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:15:37.989+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:37.989846+0000) 2020-02-12T17:15:40.969 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:15:40.967+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:40.968285+0000) 2020-02-12T17:15:40.970 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:15:40.967+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:40.968514+0000) 2020-02-12T17:15:40.971 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:15:40.967+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:40.968836+0000) 2020-02-12T17:15:40.971 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:15:40.967+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:40.968880+0000) 2020-02-12T17:15:40.971 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:15:40.967+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:40.969189+0000) 2020-02-12T17:15:40.971 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:15:40.968+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:40.969677+0000) 2020-02-12T17:15:40.972 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:15:40.968+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:40.969302+0000) 2020-02-12T17:15:40.972 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:15:40.968+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:40.969460+0000) 2020-02-12T17:15:40.972 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:40.969+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:40.969930+0000) 2020-02-12T17:15:40.973 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:15:40.968+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:40.970008+0000) 2020-02-12T17:15:40.973 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:15:40.968+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:40.970201+0000) 2020-02-12T17:15:40.973 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:15:40.969+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:40.970425+0000) 2020-02-12T17:15:40.974 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:40.972+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:40.973140+0000) 2020-02-12T17:15:40.974 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:40.972+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:40.973353+0000) 2020-02-12T17:15:40.975 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:15:40.973+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 57748 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:15:42.002 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:15:42.000+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:42.001063+0000) 2020-02-12T17:15:42.235 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:15:42.234+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:42.234345+0000) 2020-02-12T17:15:44.433 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:44.431+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:44.432206+0000) 2020-02-12T17:15:44.478 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:15:44.476+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:44.476476+0000) 2020-02-12T17:15:44.481 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:15:44.479+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:44.480482+0000) 2020-02-12T17:15:44.489 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:15:44.487+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:44.488456+0000) 2020-02-12T17:15:44.499 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:15:44.497+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:44.497655+0000) 2020-02-12T17:15:44.499 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:15:44.497+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:44.497823+0000) 2020-02-12T17:15:44.499 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:15:44.497+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:44.497869+0000) 2020-02-12T17:15:44.864 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:44.862+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:44.862955+0000) 2020-02-12T17:15:45.250 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:15:45.248+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:45.249090+0000) 2020-02-12T17:15:45.931 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:45.928+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:45.929055+0000) 2020-02-12T17:15:45.977 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:15:45.975+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:45.976284+0000) 2020-02-12T17:15:45.978 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:15:45.975+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:45.976422+0000) 2020-02-12T17:15:45.978 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:15:45.975+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:45.976586+0000) 2020-02-12T17:15:45.979 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:15:45.974+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:45.976305+0000) 2020-02-12T17:15:45.979 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:15:45.975+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:45.977010+0000) 2020-02-12T17:15:45.979 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:15:45.975+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:45.977402+0000) 2020-02-12T17:15:45.980 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:15:45.976+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:45.977956+0000) 2020-02-12T17:15:45.980 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:15:45.976+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:45.977513+0000) 2020-02-12T17:15:45.980 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:45.977+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:45.977773+0000) 2020-02-12T17:15:45.980 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:45.977+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:45.978081+0000) 2020-02-12T17:15:45.980 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:15:45.977+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:45.977774+0000) 2020-02-12T17:15:45.981 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:15:45.976+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:45.978382+0000) 2020-02-12T17:15:45.981 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:15:45.977+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:45.978620+0000) 2020-02-12T17:15:45.981 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:45.979+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:45.980118+0000) 2020-02-12T17:15:45.984 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:15:45.981+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 57793 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:15:47.745 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:15:47.742+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:47.743511+0000) 2020-02-12T17:15:47.991 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:15:47.989+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:47.990008+0000) 2020-02-12T17:15:50.986 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:15:50.983+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:50.984451+0000) 2020-02-12T17:15:50.986 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:15:50.983+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:50.984776+0000) 2020-02-12T17:15:50.987 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:15:50.983+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:50.984422+0000) 2020-02-12T17:15:50.987 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:15:50.983+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:50.984588+0000) 2020-02-12T17:15:50.989 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:15:50.984+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:50.985678+0000) 2020-02-12T17:15:50.989 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:15:50.984+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:50.986392+0000) 2020-02-12T17:15:50.990 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:15:50.984+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:50.986281+0000) 2020-02-12T17:15:50.990 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:15:50.985+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:50.986701+0000) 2020-02-12T17:15:50.990 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:15:50.984+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:50.985505+0000) 2020-02-12T17:15:50.990 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:15:50.985+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:50.985817+0000) 2020-02-12T17:15:50.990 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:15:50.985+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:50.985959+0000) 2020-02-12T17:15:50.991 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:50.985+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:50.986138+0000) 2020-02-12T17:15:50.991 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:50.985+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:50.986316+0000) 2020-02-12T17:15:50.992 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:15:50.988+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 57831 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:15:50.992 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:50.988+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:50.989304+0000) 2020-02-12T17:15:52.002 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:15:52.000+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:52.001223+0000) 2020-02-12T17:15:52.236 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:15:52.234+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:52.234525+0000) 2020-02-12T17:15:52.299 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:15:52.301 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:15:54.436 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:54.434+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:54.435190+0000) 2020-02-12T17:15:54.478 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:15:54.475+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:54.476664+0000) 2020-02-12T17:15:54.482 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:15:54.480+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:54.480696+0000) 2020-02-12T17:15:54.489 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:15:54.487+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:54.488616+0000) 2020-02-12T17:15:54.499 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:15:54.496+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:54.497849+0000) 2020-02-12T17:15:54.499 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:15:54.497+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:54.498002+0000) 2020-02-12T17:15:54.499 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:15:54.497+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:54.498075+0000) 2020-02-12T17:15:54.864 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:54.862+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:54.863156+0000) 2020-02-12T17:15:55.250 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:15:55.248+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:55.249311+0000) 2020-02-12T17:15:55.930 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:55.928+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:55.929242+0000) 2020-02-12T17:15:55.993 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:15:55.991+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:55.991790+0000) 2020-02-12T17:15:55.993 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:15:55.991+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:55.991992+0000) 2020-02-12T17:15:55.993 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:15:55.991+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:55.992232+0000) 2020-02-12T17:15:55.995 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:55.990+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:55.992453+0000) 2020-02-12T17:15:55.995 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:55.991+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:55.993374+0000) 2020-02-12T17:15:55.995 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:15:55.991+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:55.992717+0000) 2020-02-12T17:15:55.995 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:15:55.991+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:55.993100+0000) 2020-02-12T17:15:55.996 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:15:55.991+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:55.993369+0000) 2020-02-12T17:15:55.996 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:15:55.992+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:55.993661+0000) 2020-02-12T17:15:55.996 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:15:55.992+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:55.993801+0000) 2020-02-12T17:15:55.996 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:15:55.992+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:55.992983+0000) 2020-02-12T17:15:55.996 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:15:55.992+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:55.993194+0000) 2020-02-12T17:15:55.997 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:15:55.993+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:55.993931+0000) 2020-02-12T17:15:55.997 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:15:55.994+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:55.995774+0000) 2020-02-12T17:15:55.999 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:15:55.997+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 57876 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:15:57.745 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:15:57.743+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:57.743718+0000) 2020-02-12T17:15:57.991 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:15:57.989+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:15:57.990182+0000) 2020-02-12T17:16:01.001 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:16:00.999+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:00.999644+0000) 2020-02-12T17:16:01.001 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:16:00.999+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:00.999876+0000) 2020-02-12T17:16:01.002 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:16:00.999+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:00.999989+0000) 2020-02-12T17:16:01.003 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:00.998+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:01.000133+0000) 2020-02-12T17:16:01.003 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:00.999+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:01.001295+0000) 2020-02-12T17:16:01.003 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:16:00.999+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:01.001041+0000) 2020-02-12T17:16:01.003 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:16:00.999+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:01.001470+0000) 2020-02-12T17:16:01.003 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:16:00.999+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:01.000319+0000) 2020-02-12T17:16:01.004 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:16:01.000+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:01.000938+0000) 2020-02-12T17:16:01.004 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:16:01.000+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:01.001353+0000) 2020-02-12T17:16:01.006 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:16:01.000+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:01.001792+0000) 2020-02-12T17:16:01.006 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:16:01.000+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:01.002035+0000) 2020-02-12T17:16:01.006 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:16:01.000+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:01.002225+0000) 2020-02-12T17:16:01.006 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:01.002+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:01.003890+0000) 2020-02-12T17:16:01.007 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:16:01.005+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 57912 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:16:02.002 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:16:02.001+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:02.001400+0000) 2020-02-12T17:16:02.236 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:16:02.233+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:02.234689+0000) 2020-02-12T17:16:04.439 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:04.437+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:04.438353+0000) 2020-02-12T17:16:04.478 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:16:04.476+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:04.476843+0000) 2020-02-12T17:16:04.527 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:16:04.480+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:04.480897+0000) 2020-02-12T17:16:04.527 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:16:04.497+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:04.498252+0000) 2020-02-12T17:16:04.527 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:16:04.497+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:04.498218+0000) 2020-02-12T17:16:04.529 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:16:04.488+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:04.488796+0000) 2020-02-12T17:16:04.529 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:16:04.497+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:04.498059+0000) 2020-02-12T17:16:04.864 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:04.862+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:04.863342+0000) 2020-02-12T17:16:05.251 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:16:05.249+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:05.249508+0000) 2020-02-12T17:16:05.930 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:05.927+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:05.929446+0000) 2020-02-12T17:16:06.009 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:16:06.007+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:06.007652+0000) 2020-02-12T17:16:06.010 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:16:06.007+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:06.007935+0000) 2020-02-12T17:16:06.010 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:16:06.007+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:06.008194+0000) 2020-02-12T17:16:06.010 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:16:06.007+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:06.008094+0000) 2020-02-12T17:16:06.010 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:16:06.007+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:06.008396+0000) 2020-02-12T17:16:06.010 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:16:06.008+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:06.008585+0000) 2020-02-12T17:16:06.011 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:16:06.007+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:06.008694+0000) 2020-02-12T17:16:06.012 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:06.007+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:06.008981+0000) 2020-02-12T17:16:06.012 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:06.008+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:06.010025+0000) 2020-02-12T17:16:06.012 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:16:06.007+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:06.009053+0000) 2020-02-12T17:16:06.012 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:16:06.007+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:06.009288+0000) 2020-02-12T17:16:06.012 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:16:06.007+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:06.009527+0000) 2020-02-12T17:16:06.013 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:16:06.008+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:06.009686+0000) 2020-02-12T17:16:06.013 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:06.010+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:06.012396+0000) 2020-02-12T17:16:06.015 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:16:06.013+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 57957 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:16:07.745 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:16:07.743+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:07.743913+0000) 2020-02-12T17:16:07.992 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:16:07.989+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:07.990381+0000) 2020-02-12T17:16:11.016 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:16:11.014+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:11.015299+0000) 2020-02-12T17:16:11.017 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:16:11.015+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:11.015468+0000) 2020-02-12T17:16:11.018 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:16:11.014+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:11.015829+0000) 2020-02-12T17:16:11.018 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:16:11.014+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:11.016313+0000) 2020-02-12T17:16:11.018 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:11.014+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:11.016437+0000) 2020-02-12T17:16:11.019 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:11.015+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:11.016883+0000) 2020-02-12T17:16:11.019 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:16:11.015+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:11.016626+0000) 2020-02-12T17:16:11.019 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:16:11.015+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:11.016760+0000) 2020-02-12T17:16:11.019 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:16:11.015+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:11.016273+0000) 2020-02-12T17:16:11.019 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:16:11.016+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:11.016512+0000) 2020-02-12T17:16:11.019 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:16:11.016+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:11.017169+0000) 2020-02-12T17:16:11.020 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:16:11.015+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:11.017357+0000) 2020-02-12T17:16:11.020 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:16:11.017+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:11.017698+0000) 2020-02-12T17:16:11.021 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:11.018+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:11.019911+0000) 2020-02-12T17:16:11.029 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:16:11.020+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 57995 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:16:12.003 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:16:12.001+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:12.001591+0000) 2020-02-12T17:16:12.236 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:16:12.234+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:12.234896+0000) 2020-02-12T17:16:14.443 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:14.441+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:14.441625+0000) 2020-02-12T17:16:14.478 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:16:14.476+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:14.477021+0000) 2020-02-12T17:16:14.482 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:16:14.480+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:14.481091+0000) 2020-02-12T17:16:14.490 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:16:14.488+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:14.489002+0000) 2020-02-12T17:16:14.499 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:16:14.497+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:14.498250+0000) 2020-02-12T17:16:14.500 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:16:14.497+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:14.498425+0000) 2020-02-12T17:16:14.500 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:16:14.497+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:14.498418+0000) 2020-02-12T17:16:14.865 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:14.862+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:14.863533+0000) 2020-02-12T17:16:15.251 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:16:15.248+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:15.249676+0000) 2020-02-12T17:16:15.931 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:15.929+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:15.929657+0000) 2020-02-12T17:16:16.024 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:16:16.021+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:16.022897+0000) 2020-02-12T17:16:16.024 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:16:16.021+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:16.023078+0000) 2020-02-12T17:16:16.025 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:16:16.021+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:16.023214+0000) 2020-02-12T17:16:16.025 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:16:16.022+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:16.023476+0000) 2020-02-12T17:16:16.026 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:16.022+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:16.023537+0000) 2020-02-12T17:16:16.026 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:16.023+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:16.024181+0000) 2020-02-12T17:16:16.026 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:16:16.023+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:16.023889+0000) 2020-02-12T17:16:16.027 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:16:16.023+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:16.024001+0000) 2020-02-12T17:16:16.027 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:16:16.023+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:16.024219+0000) 2020-02-12T17:16:16.027 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:16:16.024+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:16.024736+0000) 2020-02-12T17:16:16.027 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:16:16.024+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:16.024935+0000) 2020-02-12T17:16:16.027 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:16:16.022+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:16.023706+0000) 2020-02-12T17:16:16.028 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:16:16.022+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:16.024341+0000) 2020-02-12T17:16:16.028 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:16.027+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:16.027656+0000) 2020-02-12T17:16:16.029 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:16:16.027+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 58040 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:16:17.745 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:16:17.743+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:17.744110+0000) 2020-02-12T17:16:17.992 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:16:17.990+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:17.990574+0000) 2020-02-12T17:16:21.032 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:16:21.029+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:21.030665+0000) 2020-02-12T17:16:21.033 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:16:21.030+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:21.030702+0000) 2020-02-12T17:16:21.033 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:16:21.030+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:21.030842+0000) 2020-02-12T17:16:21.033 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:16:21.030+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:21.031381+0000) 2020-02-12T17:16:21.033 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:21.030+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:21.031552+0000) 2020-02-12T17:16:21.034 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:16:21.029+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:21.031227+0000) 2020-02-12T17:16:21.034 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:16:21.029+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:21.031076+0000) 2020-02-12T17:16:21.034 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:16:21.030+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:21.031844+0000) 2020-02-12T17:16:21.034 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:16:21.030+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:21.032128+0000) 2020-02-12T17:16:21.034 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:16:21.030+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:21.032273+0000) 2020-02-12T17:16:21.035 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:16:21.031+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:21.032031+0000) 2020-02-12T17:16:21.035 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:16:21.031+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:21.032389+0000) 2020-02-12T17:16:21.035 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:21.032+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:21.032696+0000) 2020-02-12T17:16:21.037 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:16:21.034+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 58076 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:16:21.037 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:21.035+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:21.036215+0000) 2020-02-12T17:16:22.003 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:16:22.000+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:22.001764+0000) 2020-02-12T17:16:22.236 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:16:22.234+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:22.235103+0000) 2020-02-12T17:16:22.440 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:16:22.443 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:16:24.446 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:24.444+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:24.444772+0000) 2020-02-12T17:16:24.478 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:16:24.476+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:24.477220+0000) 2020-02-12T17:16:24.484 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:16:24.480+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:24.481252+0000) 2020-02-12T17:16:24.490 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:16:24.488+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:24.489196+0000) 2020-02-12T17:16:24.499 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:16:24.498+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:24.498439+0000) 2020-02-12T17:16:24.500 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:16:24.497+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:24.498637+0000) 2020-02-12T17:16:24.500 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:16:24.497+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:24.498672+0000) 2020-02-12T17:16:24.865 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:24.863+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:24.863655+0000) 2020-02-12T17:16:25.251 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:16:25.249+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:25.249875+0000) 2020-02-12T17:16:25.931 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:25.929+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:25.929821+0000) 2020-02-12T17:16:26.039 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:16:26.037+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:26.037930+0000) 2020-02-12T17:16:26.040 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:16:26.036+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:26.037824+0000) 2020-02-12T17:16:26.040 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:16:26.036+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:26.038374+0000) 2020-02-12T17:16:26.040 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:16:26.037+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:26.038634+0000) 2020-02-12T17:16:26.042 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:26.037+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:26.038525+0000) 2020-02-12T17:16:26.042 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:26.039+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:26.039618+0000) 2020-02-12T17:16:26.042 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:16:26.038+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:26.038754+0000) 2020-02-12T17:16:26.042 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:16:26.038+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:26.038915+0000) 2020-02-12T17:16:26.042 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:16:26.039+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:26.039999+0000) 2020-02-12T17:16:26.043 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:16:26.039+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:26.040101+0000) 2020-02-12T17:16:26.043 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:16:26.037+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:26.039074+0000) 2020-02-12T17:16:26.043 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:16:26.037+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:26.039349+0000) 2020-02-12T17:16:26.043 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:16:26.038+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:26.039777+0000) 2020-02-12T17:16:26.044 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:26.041+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:26.042148+0000) 2020-02-12T17:16:26.045 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:16:26.042+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 58121 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:16:27.745 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:16:27.743+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:27.744303+0000) 2020-02-12T17:16:27.992 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:16:27.990+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:27.990789+0000) 2020-02-12T17:16:31.047 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:31.045+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:31.045878+0000) 2020-02-12T17:16:31.047 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:16:31.045+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:31.046047+0000) 2020-02-12T17:16:31.048 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:16:31.045+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:31.046155+0000) 2020-02-12T17:16:31.049 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:16:31.044+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:31.046285+0000) 2020-02-12T17:16:31.049 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:16:31.045+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:31.046456+0000) 2020-02-12T17:16:31.049 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:16:31.045+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:31.046569+0000) 2020-02-12T17:16:31.050 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:16:31.045+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:31.046812+0000) 2020-02-12T17:16:31.050 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:16:31.045+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:31.047134+0000) 2020-02-12T17:16:31.050 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:16:31.045+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:31.047361+0000) 2020-02-12T17:16:31.050 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:31.046+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:31.046698+0000) 2020-02-12T17:16:31.051 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:16:31.046+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:31.046998+0000) 2020-02-12T17:16:31.051 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:16:31.047+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:31.047799+0000) 2020-02-12T17:16:31.051 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:16:31.047+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:31.048023+0000) 2020-02-12T17:16:31.051 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:31.050+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:31.050678+0000) 2020-02-12T17:16:31.052 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:16:31.050+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 58159 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:16:32.003 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:16:32.001+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:32.001937+0000) 2020-02-12T17:16:32.236 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:16:32.235+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:32.235317+0000) 2020-02-12T17:16:34.449 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:34.447+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:34.447949+0000) 2020-02-12T17:16:34.478 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:16:34.477+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:34.477396+0000) 2020-02-12T17:16:34.482 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:16:34.480+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:34.481426+0000) 2020-02-12T17:16:34.490 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:16:34.488+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:34.489402+0000) 2020-02-12T17:16:34.500 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:16:34.497+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:34.498815+0000) 2020-02-12T17:16:34.500 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:16:34.497+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:34.498799+0000) 2020-02-12T17:16:34.500 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:16:34.498+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:34.498638+0000) 2020-02-12T17:16:34.865 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:34.863+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:34.863788+0000) 2020-02-12T17:16:35.251 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:16:35.249+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:35.250073+0000) 2020-02-12T17:16:35.931 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:35.929+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:35.930017+0000) 2020-02-12T17:16:36.055 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:36.053+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:36.053608+0000) 2020-02-12T17:16:36.055 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:16:36.053+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:36.053733+0000) 2020-02-12T17:16:36.055 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:16:36.053+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:36.053968+0000) 2020-02-12T17:16:36.056 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:16:36.053+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:36.054135+0000) 2020-02-12T17:16:36.057 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:16:36.052+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:36.053848+0000) 2020-02-12T17:16:36.057 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:16:36.053+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:36.054559+0000) 2020-02-12T17:16:36.057 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:16:36.053+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:36.055042+0000) 2020-02-12T17:16:36.058 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:16:36.053+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:36.055171+0000) 2020-02-12T17:16:36.058 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:16:36.053+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:36.055280+0000) 2020-02-12T17:16:36.058 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:16:36.054+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:36.055593+0000) 2020-02-12T17:16:36.058 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:36.053+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:36.054389+0000) 2020-02-12T17:16:36.058 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:16:36.054+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:36.054839+0000) 2020-02-12T17:16:36.058 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:16:36.055+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:36.055744+0000) 2020-02-12T17:16:36.060 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:36.058+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:36.058873+0000) 2020-02-12T17:16:36.060 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:16:36.058+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 58204 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:16:37.745 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:16:37.743+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:37.744472+0000) 2020-02-12T17:16:37.992 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:16:37.990+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:37.991035+0000) 2020-02-12T17:16:41.063 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:16:41.060+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:41.061837+0000) 2020-02-12T17:16:41.064 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:16:41.061+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:41.061638+0000) 2020-02-12T17:16:41.064 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:16:41.061+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:41.061958+0000) 2020-02-12T17:16:41.064 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:16:41.061+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:41.062172+0000) 2020-02-12T17:16:41.064 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:16:41.062+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:41.062481+0000) 2020-02-12T17:16:41.065 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:41.060+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:41.062330+0000) 2020-02-12T17:16:41.066 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:41.061+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:41.062817+0000) 2020-02-12T17:16:41.066 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:16:41.061+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:41.062619+0000) 2020-02-12T17:16:41.066 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:16:41.061+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:41.063340+0000) 2020-02-12T17:16:41.066 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:16:41.061+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:41.063524+0000) 2020-02-12T17:16:41.066 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:16:41.062+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:41.064001+0000) 2020-02-12T17:16:41.067 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:16:41.062+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:41.063047+0000) 2020-02-12T17:16:41.067 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:16:41.063+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:41.063860+0000) 2020-02-12T17:16:41.067 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:41.064+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:41.066547+0000) 2020-02-12T17:16:41.068 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:16:41.067+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 58240 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:16:42.003 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:16:42.001+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:42.002114+0000) 2020-02-12T17:16:42.236 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:16:42.234+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:42.235492+0000) 2020-02-12T17:16:44.453 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:44.450+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:44.451869+0000) 2020-02-12T17:16:44.479 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:16:44.476+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:44.477614+0000) 2020-02-12T17:16:44.482 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:16:44.481+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:44.481627+0000) 2020-02-12T17:16:44.490 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:16:44.488+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:44.489524+0000) 2020-02-12T17:16:44.500 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:16:44.497+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:44.498848+0000) 2020-02-12T17:16:44.500 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:16:44.498+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:44.499026+0000) 2020-02-12T17:16:44.501 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:16:44.498+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:44.499029+0000) 2020-02-12T17:16:44.865 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:44.863+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:44.863997+0000) 2020-02-12T17:16:45.253 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:16:45.249+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:45.250268+0000) 2020-02-12T17:16:45.931 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:45.929+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:45.930236+0000) 2020-02-12T17:16:46.070 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:16:46.068+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:46.069271+0000) 2020-02-12T17:16:46.071 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:16:46.069+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:46.069707+0000) 2020-02-12T17:16:46.073 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:16:46.067+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:46.069428+0000) 2020-02-12T17:16:46.074 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:16:46.068+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:46.070197+0000) 2020-02-12T17:16:46.074 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:46.069+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:46.070751+0000) 2020-02-12T17:16:46.074 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:46.069+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:46.071477+0000) 2020-02-12T17:16:46.075 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:16:46.069+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:46.070883+0000) 2020-02-12T17:16:46.075 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:16:46.069+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:46.070994+0000) 2020-02-12T17:16:46.075 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:16:46.069+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:46.071474+0000) 2020-02-12T17:16:46.076 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:16:46.069+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:46.069958+0000) 2020-02-12T17:16:46.076 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:16:46.069+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:46.070150+0000) 2020-02-12T17:16:46.076 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:16:46.069+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:46.070364+0000) 2020-02-12T17:16:46.076 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:16:46.070+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:46.071150+0000) 2020-02-12T17:16:46.077 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:46.072+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:46.074343+0000) 2020-02-12T17:16:46.078 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:16:46.075+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 58285 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:16:47.746 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:16:47.744+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:47.744622+0000) 2020-02-12T17:16:47.993 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:16:47.990+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:47.991237+0000) 2020-02-12T17:16:51.078 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:16:51.076+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:51.077170+0000) 2020-02-12T17:16:51.079 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:16:51.075+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:51.077509+0000) 2020-02-12T17:16:51.079 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:51.076+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:51.078050+0000) 2020-02-12T17:16:51.079 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:16:51.077+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:51.077835+0000) 2020-02-12T17:16:51.080 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:16:51.077+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:51.078209+0000) 2020-02-12T17:16:51.080 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:16:51.077+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:51.078401+0000) 2020-02-12T17:16:51.081 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:16:51.076+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:51.078490+0000) 2020-02-12T17:16:51.081 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:16:51.077+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:51.078624+0000) 2020-02-12T17:16:51.081 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:51.077+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:51.079003+0000) 2020-02-12T17:16:51.081 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:16:51.077+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:51.079084+0000) 2020-02-12T17:16:51.082 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:16:51.077+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:51.079308+0000) 2020-02-12T17:16:51.082 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:16:51.078+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:51.078823+0000) 2020-02-12T17:16:51.082 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:16:51.078+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:51.079218+0000) 2020-02-12T17:16:51.084 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:51.080+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:51.082344+0000) 2020-02-12T17:16:51.084 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:16:51.082+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 58323 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:16:52.003 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:16:52.002+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:52.002291+0000) 2020-02-12T17:16:52.237 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:16:52.234+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:52.235681+0000) 2020-02-12T17:16:52.555 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:16:52.558 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:16:54.456 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:54.453+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:54.455060+0000) 2020-02-12T17:16:54.479 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:16:54.477+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:54.477808+0000) 2020-02-12T17:16:54.483 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:16:54.481+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:54.481811+0000) 2020-02-12T17:16:54.491 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:16:54.489+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:54.489722+0000) 2020-02-12T17:16:54.500 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:16:54.498+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:54.499038+0000) 2020-02-12T17:16:54.501 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:16:54.498+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:54.499231+0000) 2020-02-12T17:16:54.501 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:16:54.498+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:54.499251+0000) 2020-02-12T17:16:54.865 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:54.863+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:54.864154+0000) 2020-02-12T17:16:55.252 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:16:55.250+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:55.250499+0000) 2020-02-12T17:16:55.931 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:55.929+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:55.930430+0000) 2020-02-12T17:16:56.156 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:16:56.084+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:56.084943+0000) 2020-02-12T17:16:56.157 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:16:56.084+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:56.085023+0000) 2020-02-12T17:16:56.157 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:16:56.085+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:56.085653+0000) 2020-02-12T17:16:56.157 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:16:56.085+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:56.085907+0000) 2020-02-12T17:16:56.158 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:16:56.086+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:56.086631+0000) 2020-02-12T17:16:56.158 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:16:56.086+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:56.087247+0000) 2020-02-12T17:16:56.158 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:16:56.091+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 58368 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:16:56.159 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:16:56.083+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:56.085477+0000) 2020-02-12T17:16:56.159 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:16:56.084+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:56.086157+0000) 2020-02-12T17:16:56.159 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:16:56.084+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:56.086294+0000) 2020-02-12T17:16:56.160 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:56.084+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:56.086428+0000) 2020-02-12T17:16:56.160 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:56.085+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:56.086753+0000) 2020-02-12T17:16:56.160 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:16:56.088+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:56.090592+0000) 2020-02-12T17:16:56.160 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:16:56.085+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:56.086861+0000) 2020-02-12T17:16:56.161 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:16:56.085+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:56.087369+0000) 2020-02-12T17:16:57.746 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:16:57.744+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:57.744808+0000) 2020-02-12T17:16:57.992 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:16:57.990+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:16:57.991438+0000) 2020-02-12T17:17:01.095 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:17:01.092+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:01.093677+0000) 2020-02-12T17:17:01.095 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:17:01.092+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:01.093735+0000) 2020-02-12T17:17:01.096 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:17:01.093+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:01.093904+0000) 2020-02-12T17:17:01.097 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:17:01.093+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:01.094457+0000) 2020-02-12T17:17:01.097 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:01.094+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:01.094837+0000) 2020-02-12T17:17:01.097 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:01.094+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:01.094976+0000) 2020-02-12T17:17:01.097 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:17:01.094+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:01.095082+0000) 2020-02-12T17:17:01.097 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:17:01.094+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:01.095198+0000) 2020-02-12T17:17:01.098 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:17:01.094+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:01.095355+0000) 2020-02-12T17:17:01.098 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:17:01.092+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:01.094163+0000) 2020-02-12T17:17:01.098 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:17:01.092+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:01.094300+0000) 2020-02-12T17:17:01.098 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:17:01.093+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:01.094675+0000) 2020-02-12T17:17:01.098 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:17:01.094+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:01.095588+0000) 2020-02-12T17:17:01.099 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:01.098+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:01.098720+0000) 2020-02-12T17:17:01.100 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:17:01.097+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 58404 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:17:02.003 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:17:02.001+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:02.002490+0000) 2020-02-12T17:17:02.237 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:17:02.235+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:02.235854+0000) 2020-02-12T17:17:04.459 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:04.457+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:04.458155+0000) 2020-02-12T17:17:04.479 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:17:04.477+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:04.477971+0000) 2020-02-12T17:17:04.483 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:17:04.481+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:04.481990+0000) 2020-02-12T17:17:04.491 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:17:04.489+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:04.489933+0000) 2020-02-12T17:17:04.500 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:17:04.498+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:04.499395+0000) 2020-02-12T17:17:04.501 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:17:04.498+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:04.499447+0000) 2020-02-12T17:17:04.501 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:17:04.498+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:04.499273+0000) 2020-02-12T17:17:04.865 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:04.863+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:04.864353+0000) 2020-02-12T17:17:05.252 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:17:05.249+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:05.250716+0000) 2020-02-12T17:17:05.932 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:05.930+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:05.930643+0000) 2020-02-12T17:17:06.103 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:17:06.100+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:06.101377+0000) 2020-02-12T17:17:06.103 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:17:06.099+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:06.101195+0000) 2020-02-12T17:17:06.105 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:17:06.101+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:06.101733+0000) 2020-02-12T17:17:06.106 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:17:06.101+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:06.101897+0000) 2020-02-12T17:17:06.106 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:06.101+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:06.102513+0000) 2020-02-12T17:17:06.106 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:06.102+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:06.103355+0000) 2020-02-12T17:17:06.107 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:17:06.102+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:06.102790+0000) 2020-02-12T17:17:06.107 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:17:06.102+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:06.103518+0000) 2020-02-12T17:17:06.107 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:17:06.100+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:06.102069+0000) 2020-02-12T17:17:06.107 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:17:06.100+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:06.102270+0000) 2020-02-12T17:17:06.108 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:17:06.100+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:06.102307+0000) 2020-02-12T17:17:06.108 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:17:06.101+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:06.102806+0000) 2020-02-12T17:17:06.108 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:17:06.101+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:06.102902+0000) 2020-02-12T17:17:06.110 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:06.105+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:06.106205+0000) 2020-02-12T17:17:06.110 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:17:06.105+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 58449 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:17:07.746 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:17:07.744+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:07.744998+0000) 2020-02-12T17:17:07.993 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:17:07.991+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:07.991674+0000) 2020-02-12T17:17:11.110 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:17:11.107+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:11.109024+0000) 2020-02-12T17:17:11.111 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:17:11.108+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:11.109169+0000) 2020-02-12T17:17:11.111 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:17:11.108+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:11.109454+0000) 2020-02-12T17:17:11.111 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:17:11.108+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:11.109583+0000) 2020-02-12T17:17:11.112 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:17:11.108+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:11.109761+0000) 2020-02-12T17:17:11.112 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:17:11.108+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:11.109860+0000) 2020-02-12T17:17:11.112 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:17:11.108+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:11.110044+0000) 2020-02-12T17:17:11.112 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:17:11.108+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:11.110388+0000) 2020-02-12T17:17:11.113 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:17:11.110+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:11.110835+0000) 2020-02-12T17:17:11.113 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:11.110+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:11.111081+0000) 2020-02-12T17:17:11.113 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:17:11.110+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:11.111121+0000) 2020-02-12T17:17:11.114 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:17:11.109+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:11.110758+0000) 2020-02-12T17:17:11.114 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:11.113+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:11.113655+0000) 2020-02-12T17:17:11.115 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:11.113+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:11.113826+0000) 2020-02-12T17:17:11.116 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:17:11.113+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 58487 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:17:12.004 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:17:12.001+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:12.002687+0000) 2020-02-12T17:17:12.237 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:17:12.235+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:12.236051+0000) 2020-02-12T17:17:14.463 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:14.460+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:14.461397+0000) 2020-02-12T17:17:14.479 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:17:14.477+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:14.478153+0000) 2020-02-12T17:17:14.483 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:17:14.481+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:14.482128+0000) 2020-02-12T17:17:14.491 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:17:14.489+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:14.490101+0000) 2020-02-12T17:17:14.501 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:17:14.498+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:14.499613+0000) 2020-02-12T17:17:14.501 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:17:14.498+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:14.499615+0000) 2020-02-12T17:17:14.501 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:17:14.499+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:14.499466+0000) 2020-02-12T17:17:14.866 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:14.864+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:14.864581+0000) 2020-02-12T17:17:15.252 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:17:15.250+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:15.250876+0000) 2020-02-12T17:17:15.932 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:15.930+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:15.930848+0000) 2020-02-12T17:17:16.118 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:17:16.115+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:16.117037+0000) 2020-02-12T17:17:16.119 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:17:16.116+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:16.117422+0000) 2020-02-12T17:17:16.124 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:17:16.117+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:16.117597+0000) 2020-02-12T17:17:16.125 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:17:16.117+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:16.117784+0000) 2020-02-12T17:17:16.125 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:17:16.117+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:16.117951+0000) 2020-02-12T17:17:16.125 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:16.117+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:16.118305+0000) 2020-02-12T17:17:16.125 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:16.118+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:16.119100+0000) 2020-02-12T17:17:16.126 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:16.121+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:16.121995+0000) 2020-02-12T17:17:16.126 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:17:16.118+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:16.118907+0000) 2020-02-12T17:17:16.126 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:17:16.118+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:16.119558+0000) 2020-02-12T17:17:16.127 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:17:16.116+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:16.118151+0000) 2020-02-12T17:17:16.127 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:17:16.117+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:16.118499+0000) 2020-02-12T17:17:16.127 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:17:16.117+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:16.118551+0000) 2020-02-12T17:17:16.127 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:17:16.117+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:16.119141+0000) 2020-02-12T17:17:16.128 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:17:16.121+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 58532 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:17:17.746 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:17:17.744+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:17.745213+0000) 2020-02-12T17:17:17.993 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:17:17.991+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:17.991874+0000) 2020-02-12T17:17:21.126 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:17:21.124+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:21.125162+0000) 2020-02-12T17:17:21.127 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:17:21.123+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:21.125352+0000) 2020-02-12T17:17:21.127 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:17:21.124+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:21.125727+0000) 2020-02-12T17:17:21.127 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:17:21.124+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:21.125877+0000) 2020-02-12T17:17:21.128 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:17:21.124+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:21.126097+0000) 2020-02-12T17:17:21.129 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:21.125+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:21.126145+0000) 2020-02-12T17:17:21.129 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:17:21.125+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:21.126277+0000) 2020-02-12T17:17:21.129 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:17:21.126+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:21.126897+0000) 2020-02-12T17:17:21.129 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:17:21.126+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:21.127072+0000) 2020-02-12T17:17:21.129 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:17:21.126+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:21.127443+0000) 2020-02-12T17:17:21.130 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:17:21.125+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:21.126587+0000) 2020-02-12T17:17:21.130 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:17:21.125+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:21.126727+0000) 2020-02-12T17:17:21.131 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:21.129+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:21.130022+0000) 2020-02-12T17:17:21.132 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:21.130+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:21.131038+0000) 2020-02-12T17:17:21.132 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:17:21.129+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 58568 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:17:22.004 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:17:22.002+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:22.002885+0000) 2020-02-12T17:17:22.237 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:17:22.235+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:22.236262+0000) 2020-02-12T17:17:22.761 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:17:22.765 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:17:24.466 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:24.464+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:24.464713+0000) 2020-02-12T17:17:24.480 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:17:24.478+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:24.478346+0000) 2020-02-12T17:17:24.483 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:17:24.481+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:24.482314+0000) 2020-02-12T17:17:24.491 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:17:24.490+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:24.490309+0000) 2020-02-12T17:17:24.500 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:17:24.499+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:24.499634+0000) 2020-02-12T17:17:24.501 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:17:24.499+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:24.499813+0000) 2020-02-12T17:17:24.501 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:17:24.499+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:24.499808+0000) 2020-02-12T17:17:24.866 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:24.864+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:24.864755+0000) 2020-02-12T17:17:25.252 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:17:25.250+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:25.251084+0000) 2020-02-12T17:17:25.932 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:25.929+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:25.931053+0000) 2020-02-12T17:17:26.134 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:17:26.131+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:26.132677+0000) 2020-02-12T17:17:26.135 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:17:26.131+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:26.133139+0000) 2020-02-12T17:17:26.137 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:17:26.132+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:26.133780+0000) 2020-02-12T17:17:26.137 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:26.132+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:26.134116+0000) 2020-02-12T17:17:26.137 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:17:26.132+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:26.134260+0000) 2020-02-12T17:17:26.138 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:17:26.132+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:26.134424+0000) 2020-02-12T17:17:26.138 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:17:26.132+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:26.134591+0000) 2020-02-12T17:17:26.138 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:17:26.131+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:26.133330+0000) 2020-02-12T17:17:26.138 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:17:26.132+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:26.133534+0000) 2020-02-12T17:17:26.139 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:17:26.132+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:26.133645+0000) 2020-02-12T17:17:26.139 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:17:26.132+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:26.133903+0000) 2020-02-12T17:17:26.139 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:17:26.133+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:26.134987+0000) 2020-02-12T17:17:26.140 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:26.136+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:26.137638+0000) 2020-02-12T17:17:26.141 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:26.136+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:26.138434+0000) 2020-02-12T17:17:26.141 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:17:26.137+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 58614 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:17:27.747 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:17:27.745+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:27.745419+0000) 2020-02-12T17:17:27.993 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:17:27.990+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:27.992070+0000) 2020-02-12T17:17:31.142 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:17:31.140+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:31.140512+0000) 2020-02-12T17:17:31.142 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:17:31.139+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:31.140670+0000) 2020-02-12T17:17:31.143 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:17:31.139+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:31.140987+0000) 2020-02-12T17:17:31.143 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:17:31.139+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:31.141200+0000) 2020-02-12T17:17:31.144 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:17:31.140+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:31.141405+0000) 2020-02-12T17:17:31.144 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:17:31.141+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:31.141722+0000) 2020-02-12T17:17:31.144 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:17:31.141+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:31.141806+0000) 2020-02-12T17:17:31.145 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:17:31.141+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:31.142234+0000) 2020-02-12T17:17:31.145 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:17:31.141+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:31.142375+0000) 2020-02-12T17:17:31.145 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:31.140+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:31.141952+0000) 2020-02-12T17:17:31.145 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:31.140+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:31.142081+0000) 2020-02-12T17:17:31.145 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:17:31.141+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:31.142736+0000) 2020-02-12T17:17:31.145 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:17:31.141+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:31.142909+0000) 2020-02-12T17:17:31.146 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:31.143+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:31.145348+0000) 2020-02-12T17:17:31.147 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:17:31.145+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 58652 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:17:32.004 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:17:32.002+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:32.003087+0000) 2020-02-12T17:17:32.238 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:17:32.235+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:32.236455+0000) 2020-02-12T17:17:34.469 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:34.467+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:34.467901+0000) 2020-02-12T17:17:34.479 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:17:34.477+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:34.478508+0000) 2020-02-12T17:17:34.483 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:17:34.482+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:34.482526+0000) 2020-02-12T17:17:34.491 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:17:34.489+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:34.490473+0000) 2020-02-12T17:17:34.501 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:17:34.498+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:34.499815+0000) 2020-02-12T17:17:34.501 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:17:34.499+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:34.499954+0000) 2020-02-12T17:17:34.501 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:17:34.499+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:34.499956+0000) 2020-02-12T17:17:34.866 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:34.864+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:34.864922+0000) 2020-02-12T17:17:35.252 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:17:35.250+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:35.251284+0000) 2020-02-12T17:17:35.932 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:35.930+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:35.931216+0000) 2020-02-12T17:17:36.150 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:17:36.147+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:36.148039+0000) 2020-02-12T17:17:36.150 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:17:36.148+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:36.148486+0000) 2020-02-12T17:17:36.150 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:17:36.146+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:36.148342+0000) 2020-02-12T17:17:36.151 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:36.147+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:36.148715+0000) 2020-02-12T17:17:36.151 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:17:36.147+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:36.148803+0000) 2020-02-12T17:17:36.152 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:17:36.148+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:36.149018+0000) 2020-02-12T17:17:36.152 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:17:36.148+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:36.149231+0000) 2020-02-12T17:17:36.152 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:17:36.148+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:36.149391+0000) 2020-02-12T17:17:36.153 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:17:36.149+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:36.149591+0000) 2020-02-12T17:17:36.153 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:17:36.148+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:36.149704+0000) 2020-02-12T17:17:36.153 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:17:36.148+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:36.149947+0000) 2020-02-12T17:17:36.153 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:17:36.148+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:36.150081+0000) 2020-02-12T17:17:36.153 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:36.148+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:36.150422+0000) 2020-02-12T17:17:36.154 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:36.151+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:36.153354+0000) 2020-02-12T17:17:36.155 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:17:36.153+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 58698 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:17:37.747 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:17:37.745+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:37.745623+0000) 2020-02-12T17:17:37.993 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:17:37.991+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:37.992214+0000) 2020-02-12T17:17:41.157 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:17:41.155+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:41.155815+0000) 2020-02-12T17:17:41.157 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:17:41.155+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:41.155519+0000) 2020-02-12T17:17:41.157 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:17:41.155+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:41.156222+0000) 2020-02-12T17:17:41.159 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:41.154+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:41.156399+0000) 2020-02-12T17:17:41.159 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:41.155+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:41.157166+0000) 2020-02-12T17:17:41.159 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:17:41.154+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:41.156583+0000) 2020-02-12T17:17:41.160 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:17:41.155+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:41.156771+0000) 2020-02-12T17:17:41.160 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:17:41.155+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:41.157173+0000) 2020-02-12T17:17:41.160 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:17:41.155+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:41.157579+0000) 2020-02-12T17:17:41.160 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:17:41.156+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:41.157887+0000) 2020-02-12T17:17:41.160 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:17:41.156+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:41.156927+0000) 2020-02-12T17:17:41.160 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:17:41.157+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:41.157441+0000) 2020-02-12T17:17:41.161 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:17:41.157+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:41.158089+0000) 2020-02-12T17:17:41.161 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:41.158+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:41.160165+0000) 2020-02-12T17:17:41.164 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:17:41.162+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 58734 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:17:42.004 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:17:42.003+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:42.003260+0000) 2020-02-12T17:17:42.238 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:17:42.235+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:42.236648+0000) 2020-02-12T17:17:44.472 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:44.470+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:44.471326+0000) 2020-02-12T17:17:44.480 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:17:44.478+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:44.478690+0000) 2020-02-12T17:17:44.484 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:17:44.482+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:44.482662+0000) 2020-02-12T17:17:44.492 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:17:44.490+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:44.490662+0000) 2020-02-12T17:17:44.501 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:17:44.499+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:44.500024+0000) 2020-02-12T17:17:44.501 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:17:44.500+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:44.500134+0000) 2020-02-12T17:17:44.502 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:17:44.500+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:44.500135+0000) 2020-02-12T17:17:44.866 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:44.864+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:44.865106+0000) 2020-02-12T17:17:45.253 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:17:45.251+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:45.251518+0000) 2020-02-12T17:17:45.932 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:45.930+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:45.931366+0000) 2020-02-12T17:17:46.166 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:17:46.164+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:46.164492+0000) 2020-02-12T17:17:46.166 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:17:46.163+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:46.164347+0000) 2020-02-12T17:17:46.166 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:17:46.164+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:46.164745+0000) 2020-02-12T17:17:46.167 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:17:46.165+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:46.165604+0000) 2020-02-12T17:17:46.168 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:17:46.165+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:46.165754+0000) 2020-02-12T17:17:46.168 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:46.165+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:46.165932+0000) 2020-02-12T17:17:46.168 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:46.165+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:46.166383+0000) 2020-02-12T17:17:46.168 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:17:46.165+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:46.166159+0000) 2020-02-12T17:17:46.168 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:17:46.165+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:46.166284+0000) 2020-02-12T17:17:46.169 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:17:46.165+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:46.166555+0000) 2020-02-12T17:17:46.169 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:17:46.164+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:46.165293+0000) 2020-02-12T17:17:46.169 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:17:46.165+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:46.166057+0000) 2020-02-12T17:17:46.169 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:17:46.166+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:46.166641+0000) 2020-02-12T17:17:46.170 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:46.168+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:46.169132+0000) 2020-02-12T17:17:46.172 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:17:46.170+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 58780 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:17:47.747 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:17:47.744+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:47.745819+0000) 2020-02-12T17:17:47.993 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:17:47.991+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:47.992392+0000) 2020-02-12T17:17:51.174 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:17:51.171+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:51.172540+0000) 2020-02-12T17:17:51.174 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:17:51.171+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:51.172660+0000) 2020-02-12T17:17:51.174 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:17:51.171+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:51.172814+0000) 2020-02-12T17:17:51.174 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:17:51.171+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:51.173041+0000) 2020-02-12T17:17:51.176 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:17:51.172+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:51.173182+0000) 2020-02-12T17:17:51.176 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:17:51.172+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:51.173424+0000) 2020-02-12T17:17:51.176 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:17:51.172+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:51.173559+0000) 2020-02-12T17:17:51.176 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:17:51.173+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:51.173668+0000) 2020-02-12T17:17:51.176 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:51.173+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:51.173808+0000) 2020-02-12T17:17:51.177 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:51.174+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:51.174810+0000) 2020-02-12T17:17:51.177 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:17:51.173+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:51.173880+0000) 2020-02-12T17:17:51.177 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:17:51.172+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:51.173964+0000) 2020-02-12T17:17:51.177 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:17:51.173+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:51.174700+0000) 2020-02-12T17:17:51.179 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:51.177+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:51.178076+0000) 2020-02-12T17:17:51.179 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:17:51.177+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 58818 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:17:52.004 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:17:52.001+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:52.003402+0000) 2020-02-12T17:17:52.238 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:17:52.236+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:52.236819+0000) 2020-02-12T17:17:52.827 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:17:52.833 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:17:54.476 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:54.474+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:54.475177+0000) 2020-02-12T17:17:54.480 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:17:54.478+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:54.478834+0000) 2020-02-12T17:17:54.484 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:17:54.481+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:54.482850+0000) 2020-02-12T17:17:54.492 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:17:54.490+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:54.490843+0000) 2020-02-12T17:17:54.501 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:17:54.499+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:54.500170+0000) 2020-02-12T17:17:54.502 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:17:54.499+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:54.500347+0000) 2020-02-12T17:17:54.502 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:17:54.499+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:54.500343+0000) 2020-02-12T17:17:54.866 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:54.864+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:54.865269+0000) 2020-02-12T17:17:55.253 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:17:55.250+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:55.251721+0000) 2020-02-12T17:17:55.932 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:55.931+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:55.931530+0000) 2020-02-12T17:17:56.181 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:17:56.178+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:56.180301+0000) 2020-02-12T17:17:56.182 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:17:56.179+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:56.180488+0000) 2020-02-12T17:17:56.183 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:56.180+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:56.180840+0000) 2020-02-12T17:17:56.183 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:56.180+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:56.181510+0000) 2020-02-12T17:17:56.183 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:17:56.180+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:56.181019+0000) 2020-02-12T17:17:56.184 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:17:56.180+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:56.181320+0000) 2020-02-12T17:17:56.184 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:17:56.181+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:56.181619+0000) 2020-02-12T17:17:56.184 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:17:56.181+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:56.182004+0000) 2020-02-12T17:17:56.184 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:17:56.179+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:56.180938+0000) 2020-02-12T17:17:56.184 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:17:56.179+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:56.181162+0000) 2020-02-12T17:17:56.185 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:17:56.180+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:56.181945+0000) 2020-02-12T17:17:56.185 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:17:56.180+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:56.182286+0000) 2020-02-12T17:17:56.185 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:17:56.181+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:56.182370+0000) 2020-02-12T17:17:56.186 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:17:56.184+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:56.184740+0000) 2020-02-12T17:17:56.187 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:17:56.184+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 58864 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:17:57.747 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:17:57.744+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:57.746009+0000) 2020-02-12T17:17:57.994 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:17:57.992+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:17:57.992598+0000) 2020-02-12T17:18:01.189 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:18:01.186+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:01.187964+0000) 2020-02-12T17:18:01.189 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:18:01.186+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:01.187835+0000) 2020-02-12T17:18:01.190 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:01.187+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:01.188177+0000) 2020-02-12T17:18:01.190 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:01.188+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:01.189071+0000) 2020-02-12T17:18:01.191 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:18:01.187+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:01.188500+0000) 2020-02-12T17:18:01.191 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:18:01.187+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:01.188657+0000) 2020-02-12T17:18:01.191 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:18:01.187+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:01.188910+0000) 2020-02-12T17:18:01.192 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:18:01.188+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:01.189240+0000) 2020-02-12T17:18:01.192 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:18:01.189+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:01.189663+0000) 2020-02-12T17:18:01.192 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:18:01.189+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:01.189874+0000) 2020-02-12T17:18:01.193 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:18:01.189+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:01.190030+0000) 2020-02-12T17:18:01.193 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:18:01.187+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:01.189132+0000) 2020-02-12T17:18:01.193 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:18:01.187+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:01.189361+0000) 2020-02-12T17:18:01.193 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:01.191+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:01.192505+0000) 2020-02-12T17:18:01.194 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:18:01.192+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 58900 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:18:02.005 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:18:02.002+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:02.003576+0000) 2020-02-12T17:18:02.238 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:18:02.236+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:02.236991+0000) 2020-02-12T17:18:04.480 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:04.478+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:04.478915+0000) 2020-02-12T17:18:04.481 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:18:04.478+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:04.478983+0000) 2020-02-12T17:18:04.484 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:18:04.481+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:04.483042+0000) 2020-02-12T17:18:04.492 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:18:04.490+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:04.491003+0000) 2020-02-12T17:18:04.501 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:18:04.500+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:04.500341+0000) 2020-02-12T17:18:04.502 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:18:04.499+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:04.500541+0000) 2020-02-12T17:18:04.502 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:18:04.499+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:04.500554+0000) 2020-02-12T17:18:04.867 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:04.865+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:04.865459+0000) 2020-02-12T17:18:05.253 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:18:05.251+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:05.251930+0000) 2020-02-12T17:18:05.933 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:05.931+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:05.931710+0000) 2020-02-12T17:18:06.198 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:18:06.194+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:06.195540+0000) 2020-02-12T17:18:06.199 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:18:06.194+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:06.195900+0000) 2020-02-12T17:18:06.199 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:18:06.194+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:06.196009+0000) 2020-02-12T17:18:06.199 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:18:06.194+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:06.196291+0000) 2020-02-12T17:18:06.199 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:18:06.194+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:06.196405+0000) 2020-02-12T17:18:06.200 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:18:06.194+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:06.195576+0000) 2020-02-12T17:18:06.200 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:18:06.195+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:06.196146+0000) 2020-02-12T17:18:06.200 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:06.196+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:06.196624+0000) 2020-02-12T17:18:06.200 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:06.197+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:06.197633+0000) 2020-02-12T17:18:06.200 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:18:06.196+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:06.196708+0000) 2020-02-12T17:18:06.201 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:18:06.196+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:06.197135+0000) 2020-02-12T17:18:06.201 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:18:06.196+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:06.197468+0000) 2020-02-12T17:18:06.201 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:18:06.195+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:06.196855+0000) 2020-02-12T17:18:06.203 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:06.199+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:06.200302+0000) 2020-02-12T17:18:06.203 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:18:06.200+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 58946 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:18:07.747 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:18:07.744+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:07.746198+0000) 2020-02-12T17:18:07.994 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:18:07.992+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:07.992809+0000) 2020-02-12T17:18:11.205 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:18:11.202+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:11.203845+0000) 2020-02-12T17:18:11.206 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:18:11.202+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:11.204132+0000) 2020-02-12T17:18:11.206 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:18:11.202+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:11.204339+0000) 2020-02-12T17:18:11.208 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:18:11.202+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:11.204496+0000) 2020-02-12T17:18:11.208 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:18:11.202+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:11.204589+0000) 2020-02-12T17:18:11.208 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:11.203+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:11.205108+0000) 2020-02-12T17:18:11.208 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:11.204+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:11.205859+0000) 2020-02-12T17:18:11.208 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:18:11.203+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:11.205321+0000) 2020-02-12T17:18:11.209 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:18:11.203+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:11.205469+0000) 2020-02-12T17:18:11.209 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:18:11.204+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:11.205928+0000) 2020-02-12T17:18:11.209 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:18:11.203+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:11.204862+0000) 2020-02-12T17:18:11.209 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:18:11.203+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:11.205157+0000) 2020-02-12T17:18:11.210 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:18:11.204+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:11.205625+0000) 2020-02-12T17:18:11.211 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:11.207+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:11.209057+0000) 2020-02-12T17:18:11.211 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:18:11.208+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 58984 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:18:12.005 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:18:12.003+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:12.003721+0000) 2020-02-12T17:18:12.238 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:18:12.236+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:12.237190+0000) 2020-02-12T17:18:14.480 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:18:14.477+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:14.479136+0000) 2020-02-12T17:18:14.483 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:14.480+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:14.482004+0000) 2020-02-12T17:18:14.484 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:18:14.482+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:14.483205+0000) 2020-02-12T17:18:14.492 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:18:14.490+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:14.491215+0000) 2020-02-12T17:18:14.501 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:18:14.499+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:14.500500+0000) 2020-02-12T17:18:14.502 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:18:14.500+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:14.500714+0000) 2020-02-12T17:18:14.502 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:18:14.500+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:14.500713+0000) 2020-02-12T17:18:14.867 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:14.864+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:14.865671+0000) 2020-02-12T17:18:15.253 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:18:15.251+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:15.252125+0000) 2020-02-12T17:18:15.933 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:15.930+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:15.931898+0000) 2020-02-12T17:18:16.214 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:18:16.211+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:16.211712+0000) 2020-02-12T17:18:16.214 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:18:16.211+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:16.211878+0000) 2020-02-12T17:18:16.214 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:18:16.211+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:16.212068+0000) 2020-02-12T17:18:16.214 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:18:16.212+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:16.212744+0000) 2020-02-12T17:18:16.215 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:18:16.212+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:16.212861+0000) 2020-02-12T17:18:16.216 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:18:16.210+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:16.212310+0000) 2020-02-12T17:18:16.216 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:18:16.210+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:16.212506+0000) 2020-02-12T17:18:16.216 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:18:16.211+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:16.212655+0000) 2020-02-12T17:18:16.216 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:16.211+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:16.213039+0000) 2020-02-12T17:18:16.216 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:16.211+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:16.213191+0000) 2020-02-12T17:18:16.217 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:18:16.211+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:16.213564+0000) 2020-02-12T17:18:16.217 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:18:16.212+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:16.213860+0000) 2020-02-12T17:18:16.217 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:18:16.212+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:16.213369+0000) 2020-02-12T17:18:16.217 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:16.214+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:16.216298+0000) 2020-02-12T17:18:16.219 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:18:16.217+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 59029 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:18:17.747 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:18:17.745+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:17.746390+0000) 2020-02-12T17:18:17.994 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:18:17.991+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:17.992996+0000) 2020-02-12T17:18:21.220 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:18:21.218+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:21.219288+0000) 2020-02-12T17:18:21.221 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:18:21.219+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:21.219552+0000) 2020-02-12T17:18:21.221 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:18:21.218+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:21.220096+0000) 2020-02-12T17:18:21.222 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:18:21.218+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:21.220315+0000) 2020-02-12T17:18:21.222 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:21.218+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:21.220502+0000) 2020-02-12T17:18:21.223 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:18:21.220+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:21.220611+0000) 2020-02-12T17:18:21.223 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:18:21.220+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:21.221139+0000) 2020-02-12T17:18:21.223 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:18:21.220+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:21.221321+0000) 2020-02-12T17:18:21.223 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:18:21.219+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:21.221425+0000) 2020-02-12T17:18:21.224 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:18:21.219+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:21.221531+0000) 2020-02-12T17:18:21.224 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:21.220+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:21.221850+0000) 2020-02-12T17:18:21.224 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:18:21.220+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:21.222005+0000) 2020-02-12T17:18:21.224 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:18:21.221+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:21.222005+0000) 2020-02-12T17:18:21.225 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:21.222+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:21.224195+0000) 2020-02-12T17:18:21.227 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:18:21.225+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 59065 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:18:22.005 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:18:22.003+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:22.003901+0000) 2020-02-12T17:18:22.238 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:18:22.236+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:22.237381+0000) 2020-02-12T17:18:22.975 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:18:22.978 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:18:24.480 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:18:24.478+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:24.479330+0000) 2020-02-12T17:18:24.484 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:18:24.483+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:24.483385+0000) 2020-02-12T17:18:24.486 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:24.484+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:24.485119+0000) 2020-02-12T17:18:24.492 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:18:24.489+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:24.491374+0000) 2020-02-12T17:18:24.516 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:18:24.500+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:24.500934+0000) 2020-02-12T17:18:24.518 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:18:24.500+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:24.500929+0000) 2020-02-12T17:18:24.518 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:18:24.499+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:24.500678+0000) 2020-02-12T17:18:24.867 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:24.865+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:24.865862+0000) 2020-02-12T17:18:25.253 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:18:25.251+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:25.252315+0000) 2020-02-12T17:18:25.933 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:25.931+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:25.932092+0000) 2020-02-12T17:18:26.229 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:18:26.227+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:26.228213+0000) 2020-02-12T17:18:26.230 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:18:26.227+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:26.228384+0000) 2020-02-12T17:18:26.231 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:18:26.226+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:26.228437+0000) 2020-02-12T17:18:26.231 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:18:26.226+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:26.228557+0000) 2020-02-12T17:18:26.231 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:26.227+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:26.228778+0000) 2020-02-12T17:18:26.231 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:18:26.227+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:26.229181+0000) 2020-02-12T17:18:26.232 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:18:26.228+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:26.229668+0000) 2020-02-12T17:18:26.232 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:18:26.228+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:26.229055+0000) 2020-02-12T17:18:26.232 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:18:26.228+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:26.229351+0000) 2020-02-12T17:18:26.232 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:18:26.229+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:26.229570+0000) 2020-02-12T17:18:26.232 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:18:26.229+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:26.229868+0000) 2020-02-12T17:18:26.233 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:26.228+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:26.230061+0000) 2020-02-12T17:18:26.233 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:18:26.228+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:26.230357+0000) 2020-02-12T17:18:26.233 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:26.230+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:26.232431+0000) 2020-02-12T17:18:26.235 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:18:26.233+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 59110 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:18:27.747 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:18:27.746+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:27.746570+0000) 2020-02-12T17:18:27.994 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:18:27.992+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:27.993215+0000) 2020-02-12T17:18:31.237 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:18:31.235+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:31.235598+0000) 2020-02-12T17:18:31.237 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:18:31.235+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:31.235848+0000) 2020-02-12T17:18:31.237 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:18:31.235+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:31.236029+0000) 2020-02-12T17:18:31.238 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:18:31.235+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:31.236428+0000) 2020-02-12T17:18:31.238 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:31.236+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:31.236811+0000) 2020-02-12T17:18:31.239 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:18:31.236+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:31.236893+0000) 2020-02-12T17:18:31.239 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:18:31.236+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:31.237030+0000) 2020-02-12T17:18:31.239 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:18:31.235+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:31.236375+0000) 2020-02-12T17:18:31.240 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:18:31.237+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:31.237572+0000) 2020-02-12T17:18:31.241 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:18:31.237+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:31.238155+0000) 2020-02-12T17:18:31.241 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:18:31.236+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:31.237210+0000) 2020-02-12T17:18:31.241 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:18:31.236+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:31.237327+0000) 2020-02-12T17:18:31.242 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:31.237+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:31.237784+0000) 2020-02-12T17:18:31.242 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:31.240+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:31.240770+0000) 2020-02-12T17:18:31.244 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:18:31.242+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 59148 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:18:32.005 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:18:32.003+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:32.004098+0000) 2020-02-12T17:18:32.239 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:18:32.236+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:32.237568+0000) 2020-02-12T17:18:34.481 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:18:34.478+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:34.479522+0000) 2020-02-12T17:18:34.484 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:18:34.483+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:34.483603+0000) 2020-02-12T17:18:34.489 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:34.487+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:34.488372+0000) 2020-02-12T17:18:34.492 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:18:34.490+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:34.491521+0000) 2020-02-12T17:18:34.502 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:18:34.500+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:34.500892+0000) 2020-02-12T17:18:34.503 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:18:34.501+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:34.501154+0000) 2020-02-12T17:18:34.503 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:18:34.501+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:34.501155+0000) 2020-02-12T17:18:34.869 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:34.865+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:34.866042+0000) 2020-02-12T17:18:35.253 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:18:35.251+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:35.252500+0000) 2020-02-12T17:18:35.933 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:35.931+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:35.932300+0000) 2020-02-12T17:18:36.246 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:18:36.243+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:36.245295+0000) 2020-02-12T17:18:36.247 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:18:36.245+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:36.245621+0000) 2020-02-12T17:18:36.248 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:36.245+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:36.245809+0000) 2020-02-12T17:18:36.248 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:18:36.245+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:36.245963+0000) 2020-02-12T17:18:36.248 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:18:36.245+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:36.246085+0000) 2020-02-12T17:18:36.248 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:18:36.245+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:36.246269+0000) 2020-02-12T17:18:36.248 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:18:36.244+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:36.245882+0000) 2020-02-12T17:18:36.249 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:18:36.245+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:36.246472+0000) 2020-02-12T17:18:36.249 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:18:36.245+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:36.246589+0000) 2020-02-12T17:18:36.249 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:36.246+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:36.246981+0000) 2020-02-12T17:18:36.250 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:18:36.246+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:36.247183+0000) 2020-02-12T17:18:36.250 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:18:36.245+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:36.247425+0000) 2020-02-12T17:18:36.250 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:18:36.246+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:36.247506+0000) 2020-02-12T17:18:36.251 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:36.249+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:36.250510+0000) 2020-02-12T17:18:36.252 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:18:36.249+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 59193 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:18:37.748 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:18:37.745+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:37.746766+0000) 2020-02-12T17:18:37.994 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:18:37.992+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:37.993393+0000) 2020-02-12T17:18:41.254 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:18:41.252+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:41.252797+0000) 2020-02-12T17:18:41.254 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:18:41.252+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:41.253059+0000) 2020-02-12T17:18:41.254 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:18:41.252+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:41.253195+0000) 2020-02-12T17:18:41.255 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:41.252+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:41.253397+0000) 2020-02-12T17:18:41.256 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:18:41.252+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:41.253464+0000) 2020-02-12T17:18:41.256 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:18:41.252+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:41.253690+0000) 2020-02-12T17:18:41.256 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:18:41.252+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:41.254090+0000) 2020-02-12T17:18:41.256 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:18:41.252+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:41.254284+0000) 2020-02-12T17:18:41.257 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:18:41.252+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:41.254400+0000) 2020-02-12T17:18:41.257 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:41.253+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:41.253973+0000) 2020-02-12T17:18:41.257 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:18:41.254+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:41.254625+0000) 2020-02-12T17:18:41.257 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:18:41.254+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:41.254962+0000) 2020-02-12T17:18:41.258 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:18:41.253+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:41.255179+0000) 2020-02-12T17:18:41.258 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:41.256+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:41.257314+0000) 2020-02-12T17:18:41.260 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:18:41.257+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 59228 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:18:42.005 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:18:42.003+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:42.004271+0000) 2020-02-12T17:18:42.239 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:18:42.237+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:42.237729+0000) 2020-02-12T17:18:44.481 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:18:44.479+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:44.479717+0000) 2020-02-12T17:18:44.485 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:18:44.482+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:44.483771+0000) 2020-02-12T17:18:44.492 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:44.491+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:44.491607+0000) 2020-02-12T17:18:44.493 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:18:44.491+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:44.491676+0000) 2020-02-12T17:18:44.502 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:18:44.500+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:44.501109+0000) 2020-02-12T17:18:44.503 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:18:44.500+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:44.501335+0000) 2020-02-12T17:18:44.503 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:18:44.500+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:44.501332+0000) 2020-02-12T17:18:44.867 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:44.865+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:44.866257+0000) 2020-02-12T17:18:45.254 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:18:45.251+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:45.252686+0000) 2020-02-12T17:18:45.935 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:45.932+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:45.932492+0000) 2020-02-12T17:18:46.262 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:18:46.260+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:46.261111+0000) 2020-02-12T17:18:46.262 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:18:46.259+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:46.261063+0000) 2020-02-12T17:18:46.263 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:18:46.259+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:46.261409+0000) 2020-02-12T17:18:46.264 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:18:46.261+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:46.261625+0000) 2020-02-12T17:18:46.264 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:18:46.261+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:46.261721+0000) 2020-02-12T17:18:46.264 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:46.261+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:46.262217+0000) 2020-02-12T17:18:46.264 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:46.261+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:46.262471+0000) 2020-02-12T17:18:46.265 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:18:46.260+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:46.261863+0000) 2020-02-12T17:18:46.265 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:18:46.260+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:46.262338+0000) 2020-02-12T17:18:46.265 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:18:46.261+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:46.262623+0000) 2020-02-12T17:18:46.265 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:18:46.261+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:46.262762+0000) 2020-02-12T17:18:46.266 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:18:46.262+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:46.262914+0000) 2020-02-12T17:18:46.266 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:18:46.262+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:46.263211+0000) 2020-02-12T17:18:46.267 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:46.265+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:46.266036+0000) 2020-02-12T17:18:46.268 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:18:46.265+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 59274 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:18:47.748 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:18:47.746+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:47.746955+0000) 2020-02-12T17:18:47.995 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:18:47.993+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:47.993578+0000) 2020-02-12T17:18:51.270 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:18:51.267+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:51.268962+0000) 2020-02-12T17:18:51.270 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:18:51.267+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:51.269134+0000) 2020-02-12T17:18:51.271 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:18:51.268+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:51.269536+0000) 2020-02-12T17:18:51.271 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:51.269+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:51.270212+0000) 2020-02-12T17:18:51.272 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:18:51.268+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:51.269832+0000) 2020-02-12T17:18:51.272 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:18:51.268+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:51.270045+0000) 2020-02-12T17:18:51.272 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:18:51.269+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:51.270559+0000) 2020-02-12T17:18:51.273 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:18:51.269+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:51.270353+0000) 2020-02-12T17:18:51.273 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:18:51.269+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:51.270440+0000) 2020-02-12T17:18:51.273 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:18:51.270+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:51.270627+0000) 2020-02-12T17:18:51.274 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:51.270+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:51.270967+0000) 2020-02-12T17:18:51.274 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:18:51.270+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:51.271034+0000) 2020-02-12T17:18:51.274 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:18:51.269+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:51.270760+0000) 2020-02-12T17:18:51.276 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:51.274+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:51.274941+0000) 2020-02-12T17:18:51.276 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:18:51.273+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 59310 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:18:52.006 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:18:52.003+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:52.004453+0000) 2020-02-12T17:18:52.239 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:18:52.237+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:52.237843+0000) 2020-02-12T17:18:53.096 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:18:53.099 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:18:54.481 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:18:54.479+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:54.479944+0000) 2020-02-12T17:18:54.485 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:18:54.483+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:54.483945+0000) 2020-02-12T17:18:54.493 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:18:54.491+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:54.491813+0000) 2020-02-12T17:18:54.496 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:54.494+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:54.494820+0000) 2020-02-12T17:18:54.502 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:18:54.500+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:54.501266+0000) 2020-02-12T17:18:54.503 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:18:54.500+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:54.501496+0000) 2020-02-12T17:18:54.503 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:18:54.500+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:54.501500+0000) 2020-02-12T17:18:54.867 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:54.866+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:54.866443+0000) 2020-02-12T17:18:55.254 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:18:55.252+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:55.252881+0000) 2020-02-12T17:18:55.934 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:55.932+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:55.932694+0000) 2020-02-12T17:18:56.278 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:18:56.276+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:56.276923+0000) 2020-02-12T17:18:56.279 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:18:56.275+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:56.277060+0000) 2020-02-12T17:18:56.279 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:18:56.275+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:56.277189+0000) 2020-02-12T17:18:56.280 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:18:56.275+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:56.277301+0000) 2020-02-12T17:18:56.280 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:18:56.276+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:56.277843+0000) 2020-02-12T17:18:56.280 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:56.276+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:56.277527+0000) 2020-02-12T17:18:56.280 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:18:56.277+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:56.277985+0000) 2020-02-12T17:18:56.280 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:18:56.277+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:56.278113+0000) 2020-02-12T17:18:56.280 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:18:56.277+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:56.278375+0000) 2020-02-12T17:18:56.281 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:18:56.276+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:56.278367+0000) 2020-02-12T17:18:56.281 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:18:56.277+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:56.278559+0000) 2020-02-12T17:18:56.282 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:18:56.278+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:56.279136+0000) 2020-02-12T17:18:56.282 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:56.280+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:56.281510+0000) 2020-02-12T17:18:56.282 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:18:56.281+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:56.281710+0000) 2020-02-12T17:18:56.283 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:18:56.281+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 59357 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:18:57.748 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:18:57.746+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:57.747153+0000) 2020-02-12T17:18:57.995 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:18:57.992+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:18:57.993739+0000) 2020-02-12T17:19:01.285 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:19:01.282+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:01.284166+0000) 2020-02-12T17:19:01.286 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:19:01.283+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:01.284553+0000) 2020-02-12T17:19:01.287 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:01.283+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:01.284754+0000) 2020-02-12T17:19:01.287 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:19:01.283+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:01.284829+0000) 2020-02-12T17:19:01.287 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:19:01.283+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:01.285095+0000) 2020-02-12T17:19:01.287 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:19:01.283+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:01.285533+0000) 2020-02-12T17:19:01.288 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:19:01.284+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:01.285678+0000) 2020-02-12T17:19:01.288 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:19:01.283+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:01.285094+0000) 2020-02-12T17:19:01.288 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:19:01.283+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:01.285280+0000) 2020-02-12T17:19:01.288 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:19:01.284+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:01.285450+0000) 2020-02-12T17:19:01.288 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:19:01.284+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:01.285999+0000) 2020-02-12T17:19:01.289 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:01.284+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:01.285912+0000) 2020-02-12T17:19:01.289 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:19:01.284+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:01.286259+0000) 2020-02-12T17:19:01.290 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:01.288+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:01.289750+0000) 2020-02-12T17:19:01.291 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:19:01.289+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 59391 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:19:02.006 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:19:02.004+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:02.004642+0000) 2020-02-12T17:19:02.239 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:19:02.237+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:02.238022+0000) 2020-02-12T17:19:04.481 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:19:04.479+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:04.480136+0000) 2020-02-12T17:19:04.485 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:19:04.483+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:04.484160+0000) 2020-02-12T17:19:04.493 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:19:04.491+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:04.491993+0000) 2020-02-12T17:19:04.499 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:04.497+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:04.498076+0000) 2020-02-12T17:19:04.502 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:19:04.499+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:04.501393+0000) 2020-02-12T17:19:04.503 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:19:04.501+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:04.501684+0000) 2020-02-12T17:19:04.503 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:19:04.501+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:04.501713+0000) 2020-02-12T17:19:04.868 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:04.865+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:04.866632+0000) 2020-02-12T17:19:05.254 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:19:05.252+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:05.253089+0000) 2020-02-12T17:19:05.934 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:05.931+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:05.932880+0000) 2020-02-12T17:19:06.292 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:19:06.290+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:06.291390+0000) 2020-02-12T17:19:06.293 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:19:06.290+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:06.292216+0000) 2020-02-12T17:19:06.294 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:06.290+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:06.292469+0000) 2020-02-12T17:19:06.294 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:19:06.291+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:06.292005+0000) 2020-02-12T17:19:06.295 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:19:06.291+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:06.292927+0000) 2020-02-12T17:19:06.295 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:19:06.291+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:06.293047+0000) 2020-02-12T17:19:06.296 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:19:06.291+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:06.293172+0000) 2020-02-12T17:19:06.296 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:06.291+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:06.293341+0000) 2020-02-12T17:19:06.296 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:19:06.292+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:06.292805+0000) 2020-02-12T17:19:06.296 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:19:06.293+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:06.293536+0000) 2020-02-12T17:19:06.296 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:19:06.293+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:06.293713+0000) 2020-02-12T17:19:06.297 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:19:06.293+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:06.294007+0000) 2020-02-12T17:19:06.297 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:19:06.292+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:06.294309+0000) 2020-02-12T17:19:06.297 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:06.295+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:06.296741+0000) 2020-02-12T17:19:06.299 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:19:06.298+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 59438 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:19:07.748 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:19:07.747+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:07.747356+0000) 2020-02-12T17:19:07.995 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:19:07.993+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:07.993946+0000) 2020-02-12T17:19:11.302 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:19:11.299+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:11.300369+0000) 2020-02-12T17:19:11.302 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:19:11.300+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:11.300814+0000) 2020-02-12T17:19:11.303 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:19:11.299+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:11.300643+0000) 2020-02-12T17:19:11.303 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:19:11.299+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:11.301006+0000) 2020-02-12T17:19:11.303 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:19:11.299+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:11.301219+0000) 2020-02-12T17:19:11.304 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:19:11.300+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:11.301340+0000) 2020-02-12T17:19:11.304 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:19:11.301+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:11.301895+0000) 2020-02-12T17:19:11.304 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:19:11.301+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:11.302089+0000) 2020-02-12T17:19:11.304 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:19:11.301+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:11.302312+0000) 2020-02-12T17:19:11.305 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:19:11.300+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:11.302150+0000) 2020-02-12T17:19:11.305 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:11.300+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:11.302505+0000) 2020-02-12T17:19:11.305 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:11.301+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:11.302815+0000) 2020-02-12T17:19:11.306 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:19:11.300+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:11.302572+0000) 2020-02-12T17:19:11.306 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:11.303+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:11.304764+0000) 2020-02-12T17:19:11.308 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:19:11.306+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 59474 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:19:12.006 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:19:12.004+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:12.004835+0000) 2020-02-12T17:19:12.239 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:19:12.236+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:12.238139+0000) 2020-02-12T17:19:14.481 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:19:14.479+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:14.480341+0000) 2020-02-12T17:19:14.485 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:19:14.483+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:14.484372+0000) 2020-02-12T17:19:14.493 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:19:14.491+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:14.492181+0000) 2020-02-12T17:19:14.502 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:14.500+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:14.501279+0000) 2020-02-12T17:19:14.502 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:19:14.500+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:14.501511+0000) 2020-02-12T17:19:14.503 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:19:14.501+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:14.501823+0000) 2020-02-12T17:19:14.503 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:19:14.501+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:14.501879+0000) 2020-02-12T17:19:14.868 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:14.866+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:14.866810+0000) 2020-02-12T17:19:15.254 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:19:15.253+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:15.253283+0000) 2020-02-12T17:19:15.934 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:15.932+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:15.933047+0000) 2020-02-12T17:19:16.310 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:19:16.308+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:16.308625+0000) 2020-02-12T17:19:16.310 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:19:16.308+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:16.309083+0000) 2020-02-12T17:19:16.312 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:19:16.308+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:16.309235+0000) 2020-02-12T17:19:16.312 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:19:16.308+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:16.309379+0000) 2020-02-12T17:19:16.312 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:19:16.308+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:16.309553+0000) 2020-02-12T17:19:16.312 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:19:16.309+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:16.309688+0000) 2020-02-12T17:19:16.312 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:16.309+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:16.310290+0000) 2020-02-12T17:19:16.313 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:19:16.309+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:16.309849+0000) 2020-02-12T17:19:16.313 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:19:16.309+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:16.309931+0000) 2020-02-12T17:19:16.313 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:19:16.309+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:16.310349+0000) 2020-02-12T17:19:16.313 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:19:16.310+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:16.310559+0000) 2020-02-12T17:19:16.314 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:16.310+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:16.311042+0000) 2020-02-12T17:19:16.314 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:19:16.310+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:16.311123+0000) 2020-02-12T17:19:16.315 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:16.313+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:16.314000+0000) 2020-02-12T17:19:16.316 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:19:16.314+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 59521 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:19:17.748 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:19:17.747+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:17.747486+0000) 2020-02-12T17:19:17.995 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:19:17.993+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:17.994127+0000) 2020-02-12T17:19:21.318 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:19:21.316+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:21.317229+0000) 2020-02-12T17:19:21.318 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:19:21.317+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:21.317528+0000) 2020-02-12T17:19:21.320 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:19:21.317+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:21.317772+0000) 2020-02-12T17:19:21.320 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:21.317+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:21.317969+0000) 2020-02-12T17:19:21.320 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:19:21.317+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:21.318478+0000) 2020-02-12T17:19:21.320 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:19:21.318+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:21.318659+0000) 2020-02-12T17:19:21.321 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:19:21.318+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:21.318825+0000) 2020-02-12T17:19:21.321 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:19:21.317+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:21.318080+0000) 2020-02-12T17:19:21.321 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:19:21.317+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:21.318379+0000) 2020-02-12T17:19:21.322 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:21.318+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:21.319018+0000) 2020-02-12T17:19:21.322 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:19:21.319+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:21.319724+0000) 2020-02-12T17:19:21.322 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:19:21.318+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:21.319297+0000) 2020-02-12T17:19:21.322 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:19:21.318+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:21.319392+0000) 2020-02-12T17:19:21.323 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:21.322+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:21.322728+0000) 2020-02-12T17:19:21.324 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:19:21.322+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 59555 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:19:22.006 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:19:22.004+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:22.005036+0000) 2020-02-12T17:19:22.239 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:19:22.237+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:22.238311+0000) 2020-02-12T17:19:23.253 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:19:23.256 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:19:24.482 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:19:24.479+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:24.480528+0000) 2020-02-12T17:19:24.486 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:19:24.483+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:24.484606+0000) 2020-02-12T17:19:24.494 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:19:24.491+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:24.492385+0000) 2020-02-12T17:19:24.503 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:19:24.501+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:24.501692+0000) 2020-02-12T17:19:24.503 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:19:24.500+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:24.501923+0000) 2020-02-12T17:19:24.504 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:19:24.500+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:24.501987+0000) 2020-02-12T17:19:24.505 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:24.504+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:24.504487+0000) 2020-02-12T17:19:24.868 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:24.866+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:24.867001+0000) 2020-02-12T17:19:25.254 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:19:25.252+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:25.253491+0000) 2020-02-12T17:19:25.934 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:25.932+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:25.933206+0000) 2020-02-12T17:19:26.326 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:19:26.323+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:26.325161+0000) 2020-02-12T17:19:26.327 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:19:26.324+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:26.325328+0000) 2020-02-12T17:19:26.327 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:26.324+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:26.325571+0000) 2020-02-12T17:19:26.327 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:19:26.325+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:26.325835+0000) 2020-02-12T17:19:26.328 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:19:26.324+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:26.325689+0000) 2020-02-12T17:19:26.328 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:19:26.324+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:26.326207+0000) 2020-02-12T17:19:26.329 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:19:26.325+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:26.326274+0000) 2020-02-12T17:19:26.329 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:26.326+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:26.326780+0000) 2020-02-12T17:19:26.329 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:19:26.326+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:26.327018+0000) 2020-02-12T17:19:26.329 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:19:26.326+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:26.327260+0000) 2020-02-12T17:19:26.330 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:19:26.325+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:26.326595+0000) 2020-02-12T17:19:26.330 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:19:26.325+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:26.327148+0000) 2020-02-12T17:19:26.330 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:19:26.325+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:26.327374+0000) 2020-02-12T17:19:26.332 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:26.329+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:26.329805+0000) 2020-02-12T17:19:26.332 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:19:26.329+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 59602 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:19:27.749 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:19:27.746+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:27.747673+0000) 2020-02-12T17:19:27.995 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:19:27.993+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:27.994323+0000) 2020-02-12T17:19:31.334 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:31.332+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:31.333086+0000) 2020-02-12T17:19:31.334 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:19:31.332+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:31.333369+0000) 2020-02-12T17:19:31.336 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:19:31.332+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:31.333558+0000) 2020-02-12T17:19:31.336 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:19:31.332+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:31.333709+0000) 2020-02-12T17:19:31.336 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:19:31.332+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:31.333873+0000) 2020-02-12T17:19:31.337 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:19:31.332+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:31.334208+0000) 2020-02-12T17:19:31.337 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:19:31.332+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:31.334341+0000) 2020-02-12T17:19:31.337 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:19:31.333+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:31.334730+0000) 2020-02-12T17:19:31.337 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:19:31.333+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:31.334027+0000) 2020-02-12T17:19:31.337 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:19:31.333+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:31.334421+0000) 2020-02-12T17:19:31.338 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:19:31.334+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:31.334912+0000) 2020-02-12T17:19:31.338 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:19:31.334+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:31.335046+0000) 2020-02-12T17:19:31.338 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:31.335+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:31.335624+0000) 2020-02-12T17:19:31.339 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:31.337+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:31.338474+0000) 2020-02-12T17:19:31.340 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:19:31.337+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 59638 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:19:32.006 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:19:32.004+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:32.005204+0000) 2020-02-12T17:19:32.239 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:19:32.237+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:32.238480+0000) 2020-02-12T17:19:34.482 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:19:34.480+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:34.480738+0000) 2020-02-12T17:19:34.486 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:19:34.484+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:34.484800+0000) 2020-02-12T17:19:34.494 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:19:34.492+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:34.492598+0000) 2020-02-12T17:19:34.503 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:19:34.500+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:34.502077+0000) 2020-02-12T17:19:34.504 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:19:34.500+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:34.502110+0000) 2020-02-12T17:19:34.504 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:19:34.501+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:34.501872+0000) 2020-02-12T17:19:34.509 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:34.507+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:34.507943+0000) 2020-02-12T17:19:34.868 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:34.866+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:34.867209+0000) 2020-02-12T17:19:35.255 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:19:35.252+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:35.253713+0000) 2020-02-12T17:19:35.934 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:35.933+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:35.933379+0000) 2020-02-12T17:19:36.342 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:19:36.339+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:36.340814+0000) 2020-02-12T17:19:36.342 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:19:36.339+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:36.341010+0000) 2020-02-12T17:19:36.343 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:19:36.341+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:36.341678+0000) 2020-02-12T17:19:36.343 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:19:36.341+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:36.341820+0000) 2020-02-12T17:19:36.343 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:19:36.339+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:36.341320+0000) 2020-02-12T17:19:36.344 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:19:36.340+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:36.341550+0000) 2020-02-12T17:19:36.344 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:19:36.340+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:36.341898+0000) 2020-02-12T17:19:36.345 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:19:36.341+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:36.342209+0000) 2020-02-12T17:19:36.345 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:19:36.341+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:36.342292+0000) 2020-02-12T17:19:36.345 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:19:36.342+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:36.342797+0000) 2020-02-12T17:19:36.345 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:36.342+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:36.342720+0000) 2020-02-12T17:19:36.345 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:19:36.341+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:36.342619+0000) 2020-02-12T17:19:36.346 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:36.344+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:36.345497+0000) 2020-02-12T17:19:36.347 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:36.345+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:36.346352+0000) 2020-02-12T17:19:36.348 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:19:36.345+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 59685 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:19:37.749 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:19:37.747+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:37.747891+0000) 2020-02-12T17:19:37.996 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:19:37.994+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:37.994519+0000) 2020-02-12T17:19:41.350 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:19:41.347+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:41.348715+0000) 2020-02-12T17:19:41.350 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:19:41.347+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:41.349378+0000) 2020-02-12T17:19:41.351 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:19:41.348+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:41.349484+0000) 2020-02-12T17:19:41.352 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:19:41.349+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:41.349809+0000) 2020-02-12T17:19:41.352 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:41.349+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:41.349994+0000) 2020-02-12T17:19:41.352 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:41.349+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:41.350518+0000) 2020-02-12T17:19:41.353 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:19:41.349+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:41.350096+0000) 2020-02-12T17:19:41.353 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:19:41.349+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:41.350353+0000) 2020-02-12T17:19:41.353 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:19:41.350+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:41.350919+0000) 2020-02-12T17:19:41.353 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:19:41.348+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:41.350344+0000) 2020-02-12T17:19:41.353 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:19:41.349+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:41.350643+0000) 2020-02-12T17:19:41.354 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:19:41.349+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:41.350763+0000) 2020-02-12T17:19:41.354 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:19:41.350+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:41.351260+0000) 2020-02-12T17:19:41.355 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:41.353+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:41.354103+0000) 2020-02-12T17:19:41.356 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:19:41.353+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 59719 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:19:42.006 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:19:42.004+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:42.005387+0000) 2020-02-12T17:19:42.240 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:19:42.238+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:42.238651+0000) 2020-02-12T17:19:44.482 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:19:44.479+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:44.480972+0000) 2020-02-12T17:19:44.486 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:19:44.484+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:44.484979+0000) 2020-02-12T17:19:44.494 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:19:44.491+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:44.492822+0000) 2020-02-12T17:19:44.503 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:19:44.501+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:44.502054+0000) 2020-02-12T17:19:44.503 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:19:44.501+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:44.502271+0000) 2020-02-12T17:19:44.504 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:19:44.501+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:44.502353+0000) 2020-02-12T17:19:44.512 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:44.510+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:44.511192+0000) 2020-02-12T17:19:44.869 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:44.865+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:44.867410+0000) 2020-02-12T17:19:45.255 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:19:45.253+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:45.253889+0000) 2020-02-12T17:19:45.935 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:45.932+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:45.933587+0000) 2020-02-12T17:19:46.358 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:19:46.355+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:46.356771+0000) 2020-02-12T17:19:46.359 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:19:46.356+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:46.357550+0000) 2020-02-12T17:19:46.359 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:19:46.356+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:46.357578+0000) 2020-02-12T17:19:46.359 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:19:46.356+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:46.357840+0000) 2020-02-12T17:19:46.360 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:19:46.356+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:46.357745+0000) 2020-02-12T17:19:46.360 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:46.356+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:46.357995+0000) 2020-02-12T17:19:46.361 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:46.357+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:46.358742+0000) 2020-02-12T17:19:46.361 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:19:46.356+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:46.358199+0000) 2020-02-12T17:19:46.361 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:19:46.356+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:46.358345+0000) 2020-02-12T17:19:46.361 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:19:46.356+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:46.358472+0000) 2020-02-12T17:19:46.361 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:19:46.357+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:46.359092+0000) 2020-02-12T17:19:46.361 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:19:46.356+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:46.358084+0000) 2020-02-12T17:19:46.362 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:19:46.357+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:46.358596+0000) 2020-02-12T17:19:46.363 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:46.360+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:46.361867+0000) 2020-02-12T17:19:46.364 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:19:46.361+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 59768 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:19:47.749 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:19:47.747+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:47.748057+0000) 2020-02-12T17:19:47.996 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:19:47.993+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:47.994769+0000) 2020-02-12T17:19:51.366 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:19:51.364+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:51.364447+0000) 2020-02-12T17:19:51.366 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:19:51.364+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:51.364745+0000) 2020-02-12T17:19:51.367 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:19:51.363+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:51.365086+0000) 2020-02-12T17:19:51.367 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:19:51.363+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:51.365341+0000) 2020-02-12T17:19:51.367 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:19:51.364+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:51.365754+0000) 2020-02-12T17:19:51.367 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:19:51.364+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:51.365215+0000) 2020-02-12T17:19:51.368 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:19:51.365+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:51.365665+0000) 2020-02-12T17:19:51.368 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:19:51.365+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:51.365977+0000) 2020-02-12T17:19:51.369 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:19:51.364+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:51.366110+0000) 2020-02-12T17:19:51.369 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:51.364+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:51.366364+0000) 2020-02-12T17:19:51.369 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:51.365+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:51.367414+0000) 2020-02-12T17:19:51.369 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:19:51.365+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:51.366690+0000) 2020-02-12T17:19:51.370 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:19:51.366+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:51.366536+0000) 2020-02-12T17:19:51.370 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:51.367+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:51.369580+0000) 2020-02-12T17:19:51.372 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:19:51.370+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 59802 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:19:52.007 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:19:52.005+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:52.005565+0000) 2020-02-12T17:19:52.240 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:19:52.237+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:52.238843+0000) 2020-02-12T17:19:53.381 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:19:53.385 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:19:54.482 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:19:54.480+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:54.481170+0000) 2020-02-12T17:19:54.486 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:19:54.484+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:54.485174+0000) 2020-02-12T17:19:54.494 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:19:54.492+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:54.492995+0000) 2020-02-12T17:19:54.503 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:19:54.501+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:54.502238+0000) 2020-02-12T17:19:54.504 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:19:54.502+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:54.502497+0000) 2020-02-12T17:19:54.504 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:19:54.502+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:54.502551+0000) 2020-02-12T17:19:54.515 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:54.513+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:54.514516+0000) 2020-02-12T17:19:54.869 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:54.866+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:54.867595+0000) 2020-02-12T17:19:55.255 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:19:55.253+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:55.254053+0000) 2020-02-12T17:19:55.935 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:55.933+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:55.933794+0000) 2020-02-12T17:19:56.374 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:19:56.371+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:56.373259+0000) 2020-02-12T17:19:56.374 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:19:56.371+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:56.373486+0000) 2020-02-12T17:19:56.375 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:19:56.373+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:56.373753+0000) 2020-02-12T17:19:56.375 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:19:56.373+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:56.374068+0000) 2020-02-12T17:19:56.376 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:19:56.373+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:56.374399+0000) 2020-02-12T17:19:56.377 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:56.373+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:56.374650+0000) 2020-02-12T17:19:56.377 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:19:56.373+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:56.374897+0000) 2020-02-12T17:19:56.377 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:19:56.373+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:56.375039+0000) 2020-02-12T17:19:56.377 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:19:56.374+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:56.375650+0000) 2020-02-12T17:19:56.377 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:19:56.374+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:56.374688+0000) 2020-02-12T17:19:56.378 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:19:56.374+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:56.374779+0000) 2020-02-12T17:19:56.378 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:19:56.374+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:56.375154+0000) 2020-02-12T17:19:56.378 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:56.375+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:56.377487+0000) 2020-02-12T17:19:56.378 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:19:56.376+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:56.377675+0000) 2020-02-12T17:19:56.380 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:19:56.378+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 59849 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:19:57.749 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:19:57.747+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:57.748265+0000) 2020-02-12T17:19:57.996 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:19:57.994+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:19:57.994980+0000) 2020-02-12T17:20:01.382 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:20:01.380+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:01.381299+0000) 2020-02-12T17:20:01.383 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:20:01.379+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:01.381476+0000) 2020-02-12T17:20:01.384 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:20:01.380+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:01.381949+0000) 2020-02-12T17:20:01.384 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:20:01.380+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:01.382110+0000) 2020-02-12T17:20:01.384 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:20:01.381+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:01.381656+0000) 2020-02-12T17:20:01.384 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:20:01.381+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:01.381808+0000) 2020-02-12T17:20:01.384 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:20:01.381+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:01.382191+0000) 2020-02-12T17:20:01.385 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:20:01.381+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:01.382322+0000) 2020-02-12T17:20:01.385 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:20:01.382+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:01.382622+0000) 2020-02-12T17:20:01.386 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:01.380+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:01.382507+0000) 2020-02-12T17:20:01.386 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:20:01.381+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:01.382767+0000) 2020-02-12T17:20:01.387 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:20:01.381+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:01.383182+0000) 2020-02-12T17:20:01.387 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:01.385+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:01.385991+0000) 2020-02-12T17:20:01.388 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:20:01.386+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 59883 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:20:01.388 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:01.385+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:01.386863+0000) 2020-02-12T17:20:02.007 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:20:02.005+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:02.005738+0000) 2020-02-12T17:20:02.240 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:20:02.238+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:02.239014+0000) 2020-02-12T17:20:04.482 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:20:04.480+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:04.481300+0000) 2020-02-12T17:20:04.486 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:20:04.484+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:04.485361+0000) 2020-02-12T17:20:04.494 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:20:04.492+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:04.493223+0000) 2020-02-12T17:20:04.503 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:20:04.501+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:04.502436+0000) 2020-02-12T17:20:04.504 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:20:04.502+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:04.502628+0000) 2020-02-12T17:20:04.504 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:20:04.502+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:04.502718+0000) 2020-02-12T17:20:04.518 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:04.517+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:04.517671+0000) 2020-02-12T17:20:04.869 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:04.867+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:04.867763+0000) 2020-02-12T17:20:05.255 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:20:05.253+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:05.254202+0000) 2020-02-12T17:20:05.935 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:05.933+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:05.933963+0000) 2020-02-12T17:20:06.390 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:20:06.388+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:06.388672+0000) 2020-02-12T17:20:06.391 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:20:06.388+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:06.388919+0000) 2020-02-12T17:20:06.391 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:20:06.389+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:06.389671+0000) 2020-02-12T17:20:06.391 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:20:06.388+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:06.389258+0000) 2020-02-12T17:20:06.392 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:20:06.388+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:06.389391+0000) 2020-02-12T17:20:06.392 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:20:06.389+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:06.389550+0000) 2020-02-12T17:20:06.392 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:20:06.389+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:06.390282+0000) 2020-02-12T17:20:06.393 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:20:06.389+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:06.390009+0000) 2020-02-12T17:20:06.393 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:06.389+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:06.390236+0000) 2020-02-12T17:20:06.393 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:20:06.390+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:06.390742+0000) 2020-02-12T17:20:06.393 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:20:06.390+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:06.390897+0000) 2020-02-12T17:20:06.394 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:20:06.390+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:06.390544+0000) 2020-02-12T17:20:06.394 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:06.392+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:06.393234+0000) 2020-02-12T17:20:06.394 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:06.392+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:06.393440+0000) 2020-02-12T17:20:06.397 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:20:06.394+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 59932 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:20:07.749 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:20:07.748+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:07.748423+0000) 2020-02-12T17:20:07.996 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:20:07.994+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:07.995190+0000) 2020-02-12T17:20:11.399 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:20:11.396+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:11.397315+0000) 2020-02-12T17:20:11.399 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:20:11.397+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:11.397832+0000) 2020-02-12T17:20:11.401 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:20:11.396+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:11.397561+0000) 2020-02-12T17:20:11.401 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:20:11.396+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:11.397683+0000) 2020-02-12T17:20:11.401 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:20:11.396+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:11.397930+0000) 2020-02-12T17:20:11.402 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:20:11.396+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:11.398151+0000) 2020-02-12T17:20:11.402 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:20:11.396+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:11.398388+0000) 2020-02-12T17:20:11.402 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:20:11.397+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:11.398616+0000) 2020-02-12T17:20:11.402 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:20:11.398+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:11.398774+0000) 2020-02-12T17:20:11.402 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:20:11.398+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:11.399398+0000) 2020-02-12T17:20:11.403 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:20:11.398+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:11.399539+0000) 2020-02-12T17:20:11.403 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:11.399+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:11.399760+0000) 2020-02-12T17:20:11.403 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:11.399+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:11.400020+0000) 2020-02-12T17:20:11.404 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:11.402+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:11.403209+0000) 2020-02-12T17:20:11.404 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:20:11.402+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 59966 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:20:12.007 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:20:12.004+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:12.005911+0000) 2020-02-12T17:20:12.240 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:20:12.238+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:12.239206+0000) 2020-02-12T17:20:14.482 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:20:14.481+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:14.481502+0000) 2020-02-12T17:20:14.486 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:20:14.484+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:14.485593+0000) 2020-02-12T17:20:14.494 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:20:14.492+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:14.493426+0000) 2020-02-12T17:20:14.503 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:20:14.502+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:14.502634+0000) 2020-02-12T17:20:14.504 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:20:14.501+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:14.502802+0000) 2020-02-12T17:20:14.504 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:20:14.501+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:14.502884+0000) 2020-02-12T17:20:14.522 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:14.520+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:14.520968+0000) 2020-02-12T17:20:14.869 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:14.867+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:14.867922+0000) 2020-02-12T17:20:15.255 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:20:15.253+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:15.254388+0000) 2020-02-12T17:20:15.935 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:15.933+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:15.934153+0000) 2020-02-12T17:20:16.406 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:20:16.403+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:16.405213+0000) 2020-02-12T17:20:16.407 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:20:16.403+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:16.405328+0000) 2020-02-12T17:20:16.407 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:20:16.404+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:16.405639+0000) 2020-02-12T17:20:16.409 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:20:16.405+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:16.405844+0000) 2020-02-12T17:20:16.409 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:20:16.405+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:16.406172+0000) 2020-02-12T17:20:16.409 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:16.405+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:16.406313+0000) 2020-02-12T17:20:16.409 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:16.406+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:16.407403+0000) 2020-02-12T17:20:16.409 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:20:16.405+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:16.406391+0000) 2020-02-12T17:20:16.410 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:20:16.405+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:16.406516+0000) 2020-02-12T17:20:16.410 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:20:16.406+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:16.407076+0000) 2020-02-12T17:20:16.410 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:20:16.404+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:16.405996+0000) 2020-02-12T17:20:16.410 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:20:16.405+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:16.406620+0000) 2020-02-12T17:20:16.410 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:20:16.405+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:16.406902+0000) 2020-02-12T17:20:16.411 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:16.409+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:16.410393+0000) 2020-02-12T17:20:16.412 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:20:16.409+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 60013 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:20:17.750 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:20:17.747+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:17.748591+0000) 2020-02-12T17:20:17.996 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:20:17.995+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:17.995406+0000) 2020-02-12T17:20:21.415 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:20:21.411+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:21.413292+0000) 2020-02-12T17:20:21.415 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:20:21.412+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:21.413624+0000) 2020-02-12T17:20:21.415 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:20:21.412+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:21.413525+0000) 2020-02-12T17:20:21.417 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:20:21.413+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:21.413820+0000) 2020-02-12T17:20:21.417 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:20:21.413+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:21.414038+0000) 2020-02-12T17:20:21.418 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:20:21.413+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:21.414140+0000) 2020-02-12T17:20:21.418 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:21.413+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:21.414316+0000) 2020-02-12T17:20:21.418 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:21.414+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:21.414737+0000) 2020-02-12T17:20:21.418 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:20:21.413+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:21.414508+0000) 2020-02-12T17:20:21.418 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:20:21.414+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:21.415119+0000) 2020-02-12T17:20:21.419 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:20:21.413+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:21.414499+0000) 2020-02-12T17:20:21.419 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:20:21.413+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:21.414740+0000) 2020-02-12T17:20:21.419 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:20:21.413+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:21.415001+0000) 2020-02-12T17:20:21.419 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:21.418+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:21.418639+0000) 2020-02-12T17:20:21.420 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:20:21.418+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 60047 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:20:22.007 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:20:22.005+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:22.006084+0000) 2020-02-12T17:20:22.240 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:20:22.238+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:22.239397+0000) 2020-02-12T17:20:23.506 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:20:23.509 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:20:24.483 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:20:24.481+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:24.481685+0000) 2020-02-12T17:20:24.487 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:20:24.485+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:24.485806+0000) 2020-02-12T17:20:24.494 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:20:24.493+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:24.493622+0000) 2020-02-12T17:20:24.504 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:20:24.502+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:24.502791+0000) 2020-02-12T17:20:24.504 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:20:24.502+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:24.502991+0000) 2020-02-12T17:20:24.504 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:20:24.502+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:24.503117+0000) 2020-02-12T17:20:24.525 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:24.524+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:24.524210+0000) 2020-02-12T17:20:24.869 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:24.867+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:24.868117+0000) 2020-02-12T17:20:25.256 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:20:25.253+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:25.254616+0000) 2020-02-12T17:20:25.935 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:25.933+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:25.934292+0000) 2020-02-12T17:20:26.422 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:20:26.419+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:26.421210+0000) 2020-02-12T17:20:26.422 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:20:26.420+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:26.421458+0000) 2020-02-12T17:20:26.424 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:26.421+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:26.421933+0000) 2020-02-12T17:20:26.424 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:20:26.421+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:26.421937+0000) 2020-02-12T17:20:26.424 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:20:26.421+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:26.422175+0000) 2020-02-12T17:20:26.424 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:20:26.420+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:26.421745+0000) 2020-02-12T17:20:26.424 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:20:26.420+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:26.422076+0000) 2020-02-12T17:20:26.425 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:20:26.420+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:26.422380+0000) 2020-02-12T17:20:26.425 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:20:26.421+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:26.422559+0000) 2020-02-12T17:20:26.425 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:20:26.422+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:26.422771+0000) 2020-02-12T17:20:26.426 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:26.422+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:26.423092+0000) 2020-02-12T17:20:26.426 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:20:26.422+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:26.423122+0000) 2020-02-12T17:20:26.426 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:20:26.422+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:26.423208+0000) 2020-02-12T17:20:26.426 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:26.425+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:26.425776+0000) 2020-02-12T17:20:26.429 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:20:26.426+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 60096 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:20:27.750 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:20:27.747+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:27.748709+0000) 2020-02-12T17:20:27.997 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:20:27.995+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:27.995647+0000) 2020-02-12T17:20:31.431 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:20:31.428+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:31.429882+0000) 2020-02-12T17:20:31.431 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:20:31.428+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:31.430167+0000) 2020-02-12T17:20:31.432 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:20:31.429+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:31.430743+0000) 2020-02-12T17:20:31.433 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:20:31.429+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:31.430906+0000) 2020-02-12T17:20:31.433 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:20:31.429+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:31.431010+0000) 2020-02-12T17:20:31.433 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:20:31.429+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:31.431231+0000) 2020-02-12T17:20:31.433 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:20:31.429+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:31.430557+0000) 2020-02-12T17:20:31.433 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:20:31.429+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:31.430631+0000) 2020-02-12T17:20:31.434 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:20:31.429+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:31.431086+0000) 2020-02-12T17:20:31.434 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:20:31.429+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:31.431446+0000) 2020-02-12T17:20:31.434 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:31.430+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:31.431691+0000) 2020-02-12T17:20:31.435 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:31.430+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:31.431789+0000) 2020-02-12T17:20:31.435 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:20:31.430+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:31.432129+0000) 2020-02-12T17:20:31.436 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:31.433+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:31.434937+0000) 2020-02-12T17:20:31.436 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:20:31.434+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 60130 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:20:32.007 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:20:32.004+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:32.006266+0000) 2020-02-12T17:20:32.241 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:20:32.238+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:32.239569+0000) 2020-02-12T17:20:34.483 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:20:34.480+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:34.481891+0000) 2020-02-12T17:20:34.487 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:20:34.485+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:34.486009+0000) 2020-02-12T17:20:34.495 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:20:34.492+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:34.493782+0000) 2020-02-12T17:20:34.504 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:20:34.501+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:34.502911+0000) 2020-02-12T17:20:34.504 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:20:34.501+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:34.503122+0000) 2020-02-12T17:20:34.505 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:20:34.501+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:34.503230+0000) 2020-02-12T17:20:34.528 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:34.525+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:34.527321+0000) 2020-02-12T17:20:34.869 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:34.867+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:34.868284+0000) 2020-02-12T17:20:35.256 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:20:35.254+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:35.254790+0000) 2020-02-12T17:20:35.937 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:35.933+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:35.934503+0000) 2020-02-12T17:20:36.439 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:20:36.437+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:36.437664+0000) 2020-02-12T17:20:36.439 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:20:36.437+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:36.437897+0000) 2020-02-12T17:20:36.440 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:20:36.436+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:36.438209+0000) 2020-02-12T17:20:36.441 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:20:36.437+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:36.438677+0000) 2020-02-12T17:20:36.441 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:36.437+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:36.438796+0000) 2020-02-12T17:20:36.441 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:36.437+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:36.438908+0000) 2020-02-12T17:20:36.441 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:20:36.437+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:36.439008+0000) 2020-02-12T17:20:36.441 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:20:36.437+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:36.439310+0000) 2020-02-12T17:20:36.442 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:20:36.438+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:36.438575+0000) 2020-02-12T17:20:36.442 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:20:36.438+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:36.439218+0000) 2020-02-12T17:20:36.442 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:20:36.438+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:36.439400+0000) 2020-02-12T17:20:36.442 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:20:36.439+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:36.439701+0000) 2020-02-12T17:20:36.443 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:20:36.437+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:36.439578+0000) 2020-02-12T17:20:36.444 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:36.441+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:36.443045+0000) 2020-02-12T17:20:36.445 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:20:36.443+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 60177 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:20:37.750 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:20:37.748+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:37.748809+0000) 2020-02-12T17:20:37.997 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:20:37.994+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:37.995844+0000) 2020-02-12T17:20:41.447 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:20:41.445+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:41.445547+0000) 2020-02-12T17:20:41.447 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:20:41.445+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:41.445830+0000) 2020-02-12T17:20:41.448 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:20:41.445+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:41.446271+0000) 2020-02-12T17:20:41.449 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:20:41.444+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:41.446493+0000) 2020-02-12T17:20:41.449 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:20:41.445+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:41.446862+0000) 2020-02-12T17:20:41.450 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:20:41.445+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:41.447097+0000) 2020-02-12T17:20:41.450 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:20:41.445+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:41.447275+0000) 2020-02-12T17:20:41.450 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:20:41.445+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:41.447350+0000) 2020-02-12T17:20:41.450 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:41.445+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:41.447522+0000) 2020-02-12T17:20:41.450 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:41.446+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:41.447672+0000) 2020-02-12T17:20:41.451 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:20:41.446+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:41.446715+0000) 2020-02-12T17:20:41.451 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:20:41.446+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:41.446990+0000) 2020-02-12T17:20:41.451 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:20:41.447+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:41.447787+0000) 2020-02-12T17:20:41.452 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:41.450+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:41.451791+0000) 2020-02-12T17:20:41.453 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:20:41.451+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 60211 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:20:42.007 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:20:42.006+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:42.006474+0000) 2020-02-12T17:20:42.241 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:20:42.238+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:42.239739+0000) 2020-02-12T17:20:44.483 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:20:44.481+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:44.482071+0000) 2020-02-12T17:20:44.487 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:20:44.485+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:44.486184+0000) 2020-02-12T17:20:44.498 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:20:44.493+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:44.493997+0000) 2020-02-12T17:20:44.504 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:20:44.502+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:44.503046+0000) 2020-02-12T17:20:44.504 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:20:44.502+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:44.503280+0000) 2020-02-12T17:20:44.505 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:20:44.502+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:44.503337+0000) 2020-02-12T17:20:44.536 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:44.529+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:44.530465+0000) 2020-02-12T17:20:44.869 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:44.867+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:44.868446+0000) 2020-02-12T17:20:45.256 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:20:45.254+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:45.254981+0000) 2020-02-12T17:20:45.936 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:45.934+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:45.934694+0000) 2020-02-12T17:20:46.456 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:20:46.452+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:46.454410+0000) 2020-02-12T17:20:46.456 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:20:46.453+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:46.454670+0000) 2020-02-12T17:20:46.456 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:20:46.453+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:46.454234+0000) 2020-02-12T17:20:46.456 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:20:46.454+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:46.454526+0000) 2020-02-12T17:20:46.458 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:46.453+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:46.454860+0000) 2020-02-12T17:20:46.458 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:46.454+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:46.456017+0000) 2020-02-12T17:20:46.458 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:20:46.453+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:46.455493+0000) 2020-02-12T17:20:46.458 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:20:46.454+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:46.455778+0000) 2020-02-12T17:20:46.458 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:20:46.454+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:46.456340+0000) 2020-02-12T17:20:46.459 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:20:46.454+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:46.455181+0000) 2020-02-12T17:20:46.459 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:20:46.454+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:46.455401+0000) 2020-02-12T17:20:46.459 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:20:46.454+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:46.455393+0000) 2020-02-12T17:20:46.459 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:20:46.455+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:46.455740+0000) 2020-02-12T17:20:46.460 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:46.457+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:46.458914+0000) 2020-02-12T17:20:46.461 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:20:46.459+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 60259 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:20:47.750 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:20:47.748+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:47.748977+0000) 2020-02-12T17:20:47.997 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:20:47.995+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:47.996075+0000) 2020-02-12T17:20:51.463 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:20:51.460+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:51.461393+0000) 2020-02-12T17:20:51.465 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:20:51.461+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:51.461514+0000) 2020-02-12T17:20:51.465 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:20:51.461+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:51.461949+0000) 2020-02-12T17:20:51.466 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:20:51.461+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:51.461680+0000) 2020-02-12T17:20:51.467 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:20:51.461+0000 7f96b8e4f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:51.462053+0000) 2020-02-12T17:20:51.467 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:20:51.461+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:51.462212+0000) 2020-02-12T17:20:51.467 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:20:51.462+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:51.462768+0000) 2020-02-12T17:20:51.467 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:51.462+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:51.462982+0000) 2020-02-12T17:20:51.467 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:51.462+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:51.463149+0000) 2020-02-12T17:20:51.467 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:20:51.463+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:51.463641+0000) 2020-02-12T17:20:51.468 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:20:51.461+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:51.462324+0000) 2020-02-12T17:20:51.468 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:20:51.462+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:51.462626+0000) 2020-02-12T17:20:51.468 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:20:51.463+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:51.463521+0000) 2020-02-12T17:20:51.468 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:51.465+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:51.466285+0000) 2020-02-12T17:20:51.469 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:20:51.467+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 60293 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:20:52.007 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:20:52.006+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:52.006598+0000) 2020-02-12T17:20:52.241 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:20:52.239+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:52.239854+0000) 2020-02-12T17:20:53.598 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:20:53.601 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:20:54.483 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:20:54.481+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:54.482259+0000) 2020-02-12T17:20:54.487 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:20:54.486+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:54.486379+0000) 2020-02-12T17:20:54.495 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:20:54.493+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:54.494186+0000) 2020-02-12T17:20:54.504 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:20:54.502+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:54.503237+0000) 2020-02-12T17:20:54.505 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:20:54.503+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:54.503468+0000) 2020-02-12T17:20:54.505 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:20:54.503+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:54.503498+0000) 2020-02-12T17:20:54.538 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:54.533+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:54.533675+0000) 2020-02-12T17:20:54.870 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:54.868+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:54.868644+0000) 2020-02-12T17:20:55.256 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:20:55.255+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:55.255211+0000) 2020-02-12T17:20:55.936 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:55.934+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:55.934924+0000) 2020-02-12T17:20:56.470 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:20:56.469+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:56.469650+0000) 2020-02-12T17:20:56.471 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:20:56.468+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:56.469865+0000) 2020-02-12T17:20:56.471 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:20:56.469+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:56.470100+0000) 2020-02-12T17:20:56.472 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:56.469+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:56.470566+0000) 2020-02-12T17:20:56.473 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:20:56.469+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:56.470543+0000) 2020-02-12T17:20:56.473 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:20:56.469+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:56.470756+0000) 2020-02-12T17:20:56.473 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:20:56.469+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:56.470987+0000) 2020-02-12T17:20:56.473 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:20:56.470+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:56.471452+0000) 2020-02-12T17:20:56.474 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:20:56.470+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:56.471595+0000) 2020-02-12T17:20:56.474 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:56.470+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:56.471180+0000) 2020-02-12T17:20:56.474 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:20:56.470+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:56.471263+0000) 2020-02-12T17:20:56.474 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:20:56.470+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:56.471362+0000) 2020-02-12T17:20:56.474 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:20:56.471+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:56.471765+0000) 2020-02-12T17:20:56.475 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:20:56.474+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:56.474804+0000) 2020-02-12T17:20:56.476 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:20:56.473+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 60339 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:20:57.750 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:20:57.748+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:57.749170+0000) 2020-02-12T17:20:57.997 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:20:57.995+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:20:57.996296+0000) 2020-02-12T17:21:01.478 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:21:01.475+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:01.476668+0000) 2020-02-12T17:21:01.479 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:21:01.475+0000 7f8c48622700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:01.476923+0000) 2020-02-12T17:21:01.479 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:21:01.475+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:01.477183+0000) 2020-02-12T17:21:01.481 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:21:01.476+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:01.477487+0000) 2020-02-12T17:21:01.481 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:21:01.477+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:01.477924+0000) 2020-02-12T17:21:01.481 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:21:01.477+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:01.478459+0000) 2020-02-12T17:21:01.482 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:21:01.478+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:01.478715+0000) 2020-02-12T17:21:01.482 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:21:01.478+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:01.479133+0000) 2020-02-12T17:21:01.483 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:21:01.476+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:01.477749+0000) 2020-02-12T17:21:01.485 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:21:01.476+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:01.478054+0000) 2020-02-12T17:21:01.485 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:21:01.477+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:01.478538+0000) 2020-02-12T17:21:01.486 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:01.480+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:01.481319+0000) 2020-02-12T17:21:01.487 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:01.480+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:01.481517+0000) 2020-02-12T17:21:01.487 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:01.481+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:01.481680+0000) 2020-02-12T17:21:01.487 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:21:01.481+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 60373 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:21:02.008 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:21:02.005+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:02.006804+0000) 2020-02-12T17:21:02.241 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:21:02.239+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:02.240031+0000) 2020-02-12T17:21:04.483 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:21:04.481+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:04.482448+0000) 2020-02-12T17:21:04.488 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:21:04.485+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:04.486562+0000) 2020-02-12T17:21:04.495 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:21:04.494+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:04.494384+0000) 2020-02-12T17:21:04.504 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:21:04.503+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:04.503406+0000) 2020-02-12T17:21:04.505 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:21:04.502+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:04.503644+0000) 2020-02-12T17:21:04.505 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:21:04.502+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:04.503703+0000) 2020-02-12T17:21:04.538 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:04.536+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:04.537005+0000) 2020-02-12T17:21:04.870 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:04.868+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:04.868837+0000) 2020-02-12T17:21:05.256 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:21:05.254+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:05.255455+0000) 2020-02-12T17:21:05.936 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:05.934+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:05.935120+0000) 2020-02-12T17:21:06.487 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:21:06.483+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:06.484836+0000) 2020-02-12T17:21:06.487 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:21:06.483+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:06.484972+0000) 2020-02-12T17:21:06.487 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:21:06.483+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:06.485199+0000) 2020-02-12T17:21:06.488 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:21:06.483+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:06.485303+0000) 2020-02-12T17:21:06.488 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:21:06.484+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:06.485583+0000) 2020-02-12T17:21:06.489 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:21:06.485+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:06.485875+0000) 2020-02-12T17:21:06.490 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:21:06.485+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:06.486031+0000) 2020-02-12T17:21:06.490 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:21:06.485+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:06.486430+0000) 2020-02-12T17:21:06.491 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:21:06.486+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:06.486625+0000) 2020-02-12T17:21:06.492 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:06.486+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:06.486789+0000) 2020-02-12T17:21:06.492 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:06.486+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:06.487136+0000) 2020-02-12T17:21:06.492 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:21:06.486+0000 7fdd154bd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:06.486832+0000) 2020-02-12T17:21:06.492 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:21:06.484+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:06.486232+0000) 2020-02-12T17:21:06.493 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:06.488+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:06.489142+0000) 2020-02-12T17:21:06.494 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:21:06.489+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 60421 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:21:07.750 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:21:07.748+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:07.749361+0000) 2020-02-12T17:21:08.000 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:21:07.995+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:07.996511+0000) 2020-02-12T17:21:11.494 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:21:11.491+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:11.492826+0000) 2020-02-12T17:21:11.494 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:21:11.491+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:11.492988+0000) 2020-02-12T17:21:11.494 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:21:11.491+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:11.493087+0000) 2020-02-12T17:21:11.496 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:21:11.492+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:11.493374+0000) 2020-02-12T17:21:11.496 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:21:11.493+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:11.493613+0000) 2020-02-12T17:21:11.496 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:21:11.493+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:11.493862+0000) 2020-02-12T17:21:11.496 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:21:11.493+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:11.494120+0000) 2020-02-12T17:21:11.496 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:21:11.493+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:11.494336+0000) 2020-02-12T17:21:11.497 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:11.493+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:11.494539+0000) 2020-02-12T17:21:11.497 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:21:11.492+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:11.493549+0000) 2020-02-12T17:21:11.497 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:21:11.492+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:11.493975+0000) 2020-02-12T17:21:11.497 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:21:11.493+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:11.494717+0000) 2020-02-12T17:21:11.498 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:11.494+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:11.494921+0000) 2020-02-12T17:21:11.499 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:11.497+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:11.497924+0000) 2020-02-12T17:21:11.500 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:21:11.497+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 60455 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:21:12.008 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:21:12.005+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:12.006975+0000) 2020-02-12T17:21:12.241 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:21:12.240+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:12.240179+0000) 2020-02-12T17:21:14.490 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:21:14.486+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:14.486769+0000) 2020-02-12T17:21:14.490 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:21:14.482+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:14.482624+0000) 2020-02-12T17:21:14.495 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:21:14.494+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:14.494628+0000) 2020-02-12T17:21:14.504 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:21:14.503+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:14.503580+0000) 2020-02-12T17:21:14.505 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:21:14.503+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:14.503783+0000) 2020-02-12T17:21:14.505 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:21:14.503+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:14.503880+0000) 2020-02-12T17:21:14.541 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:14.540+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:14.540276+0000) 2020-02-12T17:21:14.870 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:14.869+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:14.869066+0000) 2020-02-12T17:21:15.257 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:21:15.255+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:15.255695+0000) 2020-02-12T17:21:15.936 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:15.934+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:15.935312+0000) 2020-02-12T17:21:16.502 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:21:16.499+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:16.501199+0000) 2020-02-12T17:21:16.503 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:21:16.499+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:16.501376+0000) 2020-02-12T17:21:16.503 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:21:16.500+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:16.501594+0000) 2020-02-12T17:21:16.503 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:21:16.500+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:16.501679+0000) 2020-02-12T17:21:16.504 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:16.500+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:16.501927+0000) 2020-02-12T17:21:16.505 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:21:16.500+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:16.502194+0000) 2020-02-12T17:21:16.505 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:21:16.501+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:16.502647+0000) 2020-02-12T17:21:16.505 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:21:16.501+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:16.502757+0000) 2020-02-12T17:21:16.505 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:21:16.501+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:16.502925+0000) 2020-02-12T17:21:16.506 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:21:16.502+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:16.503581+0000) 2020-02-12T17:21:16.506 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:21:16.501+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:16.503078+0000) 2020-02-12T17:21:16.506 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:21:16.501+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:16.503260+0000) 2020-02-12T17:21:16.506 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:16.502+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:16.503800+0000) 2020-02-12T17:21:16.507 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:16.503+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:16.505493+0000) 2020-02-12T17:21:16.508 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:21:16.505+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 60501 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:21:17.751 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:21:17.749+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:17.749621+0000) 2020-02-12T17:21:17.998 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:21:17.995+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:17.996709+0000) 2020-02-12T17:21:21.510 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:21:21.507+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:21.508617+0000) 2020-02-12T17:21:21.510 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:21:21.507+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:21.508632+0000) 2020-02-12T17:21:21.510 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:21:21.507+0000 7f3f51c36700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:21.509115+0000) 2020-02-12T17:21:21.512 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:21:21.508+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:21.509648+0000) 2020-02-12T17:21:21.512 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:21:21.508+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:21.509728+0000) 2020-02-12T17:21:21.512 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:21:21.508+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:21.510142+0000) 2020-02-12T17:21:21.512 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:21.508+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:21.510369+0000) 2020-02-12T17:21:21.513 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:21.508+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:21.510543+0000) 2020-02-12T17:21:21.513 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:21:21.509+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:21.510682+0000) 2020-02-12T17:21:21.513 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:21:21.508+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:21.509552+0000) 2020-02-12T17:21:21.513 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:21:21.508+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:21.509897+0000) 2020-02-12T17:21:21.513 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:21:21.508+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:21.509998+0000) 2020-02-12T17:21:21.514 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:21:21.509+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:21.511011+0000) 2020-02-12T17:21:21.514 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:21.510+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:21.512174+0000) 2020-02-12T17:21:21.516 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:21:21.513+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 60535 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:21:22.008 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:21:22.006+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:22.007129+0000) 2020-02-12T17:21:22.241 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:21:22.238+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:22.240359+0000) 2020-02-12T17:21:23.709 INFO:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:21:23.712 INFO:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:21:24.484 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:21:24.481+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:24.482816+0000) 2020-02-12T17:21:24.488 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:21:24.486+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:24.486950+0000) 2020-02-12T17:21:24.496 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:21:24.493+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:24.494837+0000) 2020-02-12T17:21:24.505 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:21:24.502+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:24.503717+0000) 2020-02-12T17:21:24.505 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:21:24.503+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:24.503927+0000) 2020-02-12T17:21:24.506 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:21:24.503+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:24.504011+0000) 2020-02-12T17:21:24.545 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:24.542+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:24.543623+0000) 2020-02-12T17:21:24.870 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:24.868+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:24.869279+0000) 2020-02-12T17:21:25.257 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:21:25.255+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:25.255895+0000) 2020-02-12T17:21:25.937 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:25.934+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:25.935502+0000) 2020-02-12T17:21:26.518 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:21:26.515+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:26.516936+0000) 2020-02-12T17:21:26.519 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:21:26.516+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:26.517029+0000) 2020-02-12T17:21:26.519 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:21:26.516+0000 7f0fcc4e9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:26.517206+0000) 2020-02-12T17:21:26.519 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:21:26.516+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:26.517388+0000) 2020-02-12T17:21:26.519 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:21:26.515+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:26.517464+0000) 2020-02-12T17:21:26.520 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:21:26.516+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:26.517650+0000) 2020-02-12T17:21:26.520 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:21:26.516+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:26.517745+0000) 2020-02-12T17:21:26.521 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:21:26.517+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:26.518348+0000) 2020-02-12T17:21:26.521 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:21:26.518+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:26.518517+0000) 2020-02-12T17:21:26.521 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:21:26.518+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:26.518808+0000) 2020-02-12T17:21:26.521 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:21:26.517+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:26.518742+0000) 2020-02-12T17:21:26.521 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:26.517+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:26.519193+0000) 2020-02-12T17:21:26.523 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:26.520+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:26.521826+0000) 2020-02-12T17:21:26.523 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:26.521+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:26.522683+0000) 2020-02-12T17:21:26.524 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:21:26.522+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 60583 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:21:27.751 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:21:27.749+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:27.749814+0000) 2020-02-12T17:21:27.998 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:21:27.995+0000 7f1ffb3eb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:27.996902+0000) 2020-02-12T17:21:31.526 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:21:31.524+0000 7f3f50c34700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:31.524665+0000) 2020-02-12T17:21:31.526 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:21:31.524+0000 7fd1a87bc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:31.525142+0000) 2020-02-12T17:21:31.526 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:21:31.524+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:31.525017+0000) 2020-02-12T17:21:31.528 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:21:31.524+0000 7fd634c01700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:31.525669+0000) 2020-02-12T17:21:31.528 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:21:31.524+0000 7f46f4029700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:31.526061+0000) 2020-02-12T17:21:31.528 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:21:31.524+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:31.526312+0000) 2020-02-12T17:21:31.528 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:31.525+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:31.526640+0000) 2020-02-12T17:21:31.528 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:21:31.525+0000 7f96b9650700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:31.526744+0000) 2020-02-12T17:21:31.529 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:21:31.525+0000 7f2009a9d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:31.526813+0000) 2020-02-12T17:21:31.529 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:21:31.525+0000 7f8c860c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:31.525579+0000) 2020-02-12T17:21:31.529 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:21:31.525+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:31.525964+0000) 2020-02-12T17:21:31.529 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:21:31.525+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:31.526386+0000) 2020-02-12T17:21:31.530 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:31.525+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:31.527157+0000) 2020-02-12T17:21:31.530 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:31.527+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:31.529169+0000) 2020-02-12T17:21:31.532 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:21:31.530+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 60617 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:21:32.008 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:21:32.007+0000 7f3f4dc2e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:32.007291+0000) 2020-02-12T17:21:32.242 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:21:32.239+0000 7fd631bfb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:32.240529+0000) 2020-02-12T17:21:34.484 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:21:34.482+0000 7f96a9f9c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:34.483032+0000) 2020-02-12T17:21:34.488 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:21:34.486+0000 7f8c38f6e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:34.487161+0000) 2020-02-12T17:21:34.499 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:21:34.494+0000 7fdd0660a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:34.495050+0000) 2020-02-12T17:21:34.505 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:21:34.503+0000 7f46e5977700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:34.503873+0000) 2020-02-12T17:21:34.505 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:21:34.503+0000 7f0fbd636700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:34.504146+0000) 2020-02-12T17:21:34.506 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:21:34.503+0000 7f124b9cf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:34.504196+0000) 2020-02-12T17:21:34.548 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:34.546+0000 7f73c5c8b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:34.546776+0000) 2020-02-12T17:21:34.870 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:34.868+0000 7f73a120d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:34.869475+0000) 2020-02-12T17:21:35.258 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:21:35.255+0000 7f8c808b6700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:35.256105+0000) 2020-02-12T17:21:35.937 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:35.935+0000 7f73981fb700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:35.935692+0000) 2020-02-12T17:21:36.534 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:21:36.532+0000 7fd1a77ba700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:36.533351+0000) 2020-02-12T17:21:36.535 INFO:tasks.ceph.osd.7.smithi072.stderr:2020-02-12T17:21:36.533+0000 7f125b083700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:36.533725+0000) 2020-02-12T17:21:36.535 INFO:tasks.ceph.mgr.x.smithi072.stderr:2020-02-12T17:21:36.533+0000 7f8c868c2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:36.534142+0000) 2020-02-12T17:21:36.536 INFO:tasks.ceph.mds.a.smithi139.stderr:2020-02-12T17:21:36.533+0000 7fd635402700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:36.534194+0000) 2020-02-12T17:21:36.537 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:36.533+0000 7f73cbc97700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:36.534365+0000) 2020-02-12T17:21:36.537 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:36.534+0000 7f73cb496700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:36.534788+0000) 2020-02-12T17:21:36.537 INFO:tasks.ceph.osd.1.smithi139.stderr:2020-02-12T17:21:36.534+0000 7f46f502b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:36.534851+0000) 2020-02-12T17:21:36.537 INFO:tasks.ceph.osd.0.smithi139.stderr:2020-02-12T17:21:36.534+0000 7f96b864e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:36.535018+0000) 2020-02-12T17:21:36.537 INFO:tasks.ceph.osd.3.smithi139.stderr:2020-02-12T17:21:36.534+0000 7fdd15cbe700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:36.535217+0000) 2020-02-12T17:21:36.538 INFO:tasks.ceph.mds.b.smithi072.stderr:2020-02-12T17:21:36.534+0000 7f3f51435700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:36.534540+0000) 2020-02-12T17:21:36.538 INFO:tasks.ceph.osd.5.smithi072.stderr:2020-02-12T17:21:36.534+0000 7f0fcccea700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:36.535097+0000) 2020-02-12T17:21:36.538 INFO:tasks.ceph.osd.4.smithi072.stderr:2020-02-12T17:21:36.534+0000 7f8c47e21700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:36.535357+0000) 2020-02-12T17:21:36.538 INFO:tasks.ceph.osd.2.smithi139.stderr:2020-02-12T17:21:36.535+0000 7f200aa9f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:36.535653+0000) 2020-02-12T17:21:36.539 INFO:tasks.ceph.mgr.y.smithi139.stderr:2020-02-12T17:21:36.536+0000 7f73cac95700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:36.537300+0000) 2020-02-12T17:21:36.540 INFO:tasks.ceph.mon.c.smithi072.stderr:2020-02-12T17:21:36.538+0000 7fb6c8310700 -1 mon.c@2(probing) e1 get_health_metrics reporting 60663 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:21:37.751 INFO:tasks.ceph.osd.6.smithi072.stderr:2020-02-12T17:21:37.749+0000 7fd199108700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2020-02-12T16:21:37.750025+0000) 2020-02-12T17:21:37.815 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-02-12T17:21:37.815 DEBUG:teuthology.task.console_log:Killing console logger for smithi139 2020-02-12T17:21:37.815 DEBUG:teuthology.task.console_log:Killing console logger for smithi072 2020-02-12T17:21:37.816 DEBUG:teuthology.task.console_log:Killing console logger for smithi139 2020-02-12T17:21:37.816 DEBUG:teuthology.task.console_log:Killing console logger for smithi072 2020-02-12T17:21:37.816 DEBUG:teuthology.exit:Finished running handlers